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Q.1. Define an algorithm. 


Ans, Any well-defined computational Procedure that takes some value, or 
sets of values, as input and produces some value, or sets of values, as output 
is called an algorithm. 

So, in other words, we can say that a sequence of computational steps 
that transforms input into the output is known as an algorithm. 


0.2. Is there any difference among algorithm, pseudocode and program? 
Explain. (R.GP¥., June 2017) 


Ans. Difference among algorithm, pseudocode and Program are as 


follows — 
- (i) An algorithm is well defined sequenced collection of finite set of 
instructions for solving a particular problem. 

Pseudocode is an approach of writing algorithm in the programming friendly 
wage (exactly in Programming language is not necessary). 

A program is sequenced collection of instructions written in a particular 
wage (called programming language like C, C++, Java ete.) which 
mands computer to perform specific task/tasks. 


__ Mi) A pseudocode or program can be called as algorithm but vice- 
versa is not true, 


lang 


lang, 
com 


(iii) Program can be called as pseudocode but vice-versa is not true. 
(iv) Algorithms are written only is sequence, pseudocodes are written 
ce and by using some predefined keywords but program are written 
ice, using some predefined keywords and also it follows some rules 
Y grammar of programming language. 

(v) Algorithm can be thought of as rough idea of any product, 
de is blueprint of that product and program is the final product. 


in Sequen, 
™ sequen 
80Vern by 


PSeudoco, 
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Q.3. Discuss important characteristics of an algorithm. 


Ans. An algorithm is a finite set of instructions that, if followed, 
accomplishes a particular task. Below, we have some criteria or characteristics 
that are to be followed by all the algorithms — 

(i) Input — An algorithm should take zero or more quantities as| 
input, that are externally supplied. 

(ii) Output — An algorithm should produce at least one output. 

(iii) Definiteness — Each and every instruction in an algorithm should 
be very clear and unambiguous. 

(iv) Finiteness — An algorithm must be such that if we trace out its 
instructions, then for all cases, the algorithm terminates after a finite number 
of steps. 

(v) Effectiveness — In an algorithm, every instruction must be very) 
basic so that it can be carried out, in principle, by a person using only pencil 
and paper. It is not enough that each operation be definite as in criterion (iii); it 
must also be feasible. 

For example, in recursion, if we talk about factorial function, it could be 
given as — 
(a) ifn =0, then n! = 1 
(b) if n> 0, then n! = n.(n — 1)!. 
If we write algorithm for finding factorial of any number then it will 
follow all the above specified criteria in following manner— 
(i) Input— A number n whose factorial is to be found. 
(ii) Output — A number, i.e., factorial of number n. 
(iii) Definiteness — Each instruction is definite, i.e., the function to 
be done is to just multiply the number n with one less than that of it, ie, 
n-— 1, means — 


n(n— 1). 
(iv) Finiteness — Algorithm will terminate when n will become zerd 
as =f 


(v) Effectiveness — Each instruction, i.e., n(n — 1) is very basic and] 
can be done using pencil and par er. 


Q.4. How can the algorithms be designed ? 


Ans. The term designing algorithm means creating an algorithm thal 
accomplishes a particular task. Creating an algorithm is an art which maj| 
never be fully automated. 
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There are many ways to design algorithms. We have many design 
techniques that have proven to be useful in that they have often yielded good 
alg rithms. These design Strategies make it easy to devise new and useful 
algorithms. For example, some of design approaches are “Divide-and-Conquer”, 
“Dynamic Programming”, etc. ; 

Acommon approach to solving a problem is to partition the problem into 
smaller parts, find solutions for the parts, and then combine the solutions for 
the parts into a solution for the whole. 


Q.5. What do you mean by performance analysis of an algorithm ? 
Explain. (R.GPM, Dec. 2014) 


Ans. The efficiency of an algorithm can be decided by measuring the 
performance of an algorithm. The performance of an algorithm can be 
measured by computing two factors — 

(i) Amount of time required by an algorithm to execute (time 
complexity) 
(ii) Amount of storage required by an algorithm (space complexity). 

0.6. Explain the various criteria used for analyzing algorithm. 

(R.GP.¥., May 2018) 
Or 
What criteria are used during the analysis of the algorithm ? 
(R.GPM, Dec. 2017) 

Ans. There are many criteria upon which we can judge algorithm, as by 

judging following things — 

(i) Does it do what we want it to do ? 

(ii) Does it work correctly according to the original specifications 
of task ? 

(iii) Is there documentation that describes how to use it and how it 
works ? 

(iv) Are procedure created in such a way that they perform logical 
subfunctions ? 

(v) Is the code readable ? 

The above criteria are all vitally important when it comes to writing 
software, most especially for large systems. 

___ All the above criteria for judging algorithms are important, but two most 
‘portant factors are — 
(i) Space complexity (ii) Time complexity. 


2.7. Define algorithm. Discuss how to analyse algorithms. 
(R.GPY., June 2016) 


Ans. Algorithm — Refer to Ql. 
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Analyzing an algorithm means analysis of an algorithm. Analyzing a 
algorithm has come to mean predicting the resources that the algorithm required 

When an algorithm is executed, it acquires some of the resources sy 
as computer’s central processing unit (CPU) to perform operations and j 
memory (both immediate and auxiliary) to hold the program and dat 
communication bandwidth, or logic gates, but most often it is computation, 
time and storage an algorithm requires that we want to measure. 

This is not easy to measure. Sometimes great mathematical skills 
required to measure it. Mathematical tools required may include discr 
combinatorics, elementary probability theory, algebraic dexterity, and the abili 
to identify the most significant terms in a formula. 

Because the behaviour of an algorithm may be different for each possibl 
input, we need a means for summarizing that behaviour in simple, easil 
understood formula. 

During the analysis of an algorithm our one immediate goal is to find 
means of expression that is simple to write and manipulate, shows the importan 
characteristics of an algorithm’s resource requirements, and suppresses tediou 
details. 

For example, the time taken by the insertion-sort procedure depends 
the input. As sorting hundreds of numbers takes longer than sorting five numbe! 
Secondly, insertion-sort can take different amounts of time to sort two inj 
sequences of the same size depending on how nearly sorted they already are. 

Actually, the time taken by an algorithm grows with the size of the inpu 
We describe the running time of a program as a function of the size of its inp 

Performance analysis of an algorithm enables us to make quantitativ 
judgements about the value of one algorithm over another. Also, it allows 4 
to predict whether the software will meet any efficiency constraints that exis! 

Finally, analysis of an algorithm describes how well an algorithm perform! 
in the best-case, in the worst-case and in average-case. 


Q.8. How is an algorithm analysed ? What do you understand by way; 
average-case and worst-case of an algorithm ? (R.GRY., Dec. 2011, June 201: 


Ans. Algorithm Analysed — Refer to Q.7. 

During the analysis of an algorithm we check the algorithm for ater 
different inputs. Depending on the time taken by an algorithm to execu! 
different input, worst-case, average-case, and best-case are measured. 


(i) Worst-case — The worst-case running time of an algorithm is 
upper bound on the running time for any input. Knowing it gives us a guarant 
that the algorithm will never take any longer. We need not make some educat® 
guess about the running time and hope that it never gets much worse. 
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For example, in insertion-sort algorithm, worst-case is one in which the 

input array is in reverse order, Similarly, in searching a database fora particular 

piece of information, the searching algorithms worst case will often occur 
when the information is not present in the database. And in this case of searchin, 

an absent information may be frequent. 8 


(ii) Average-case — The ayerage-case running time of an algorithm 
is an average bound on the running time for any input. 
Roughly, it is often as bad as the worst-case. 
For example, if we randomly choose n numbers and apply insertion- 
sort, we have to calculate average time to determine where in subarray 
.i — 1] to insert element A[i] ? In an average-case, half of the 
elements in Afi -i — 1] are less than A[i] and half the elements are 
greater. In such a case we have to check only half of the elements of the 
subarray A[1.... i — 1], so 
t= 1/2. 
Generally, average-case running time turns out to be a quadratic function 
of the input size, i.e., similar to a worst-case running time. 


(iii) Best-case — The best-case running time of an algorithm is a 
lower bound on the running time for any input. 

In the best-case we have to do minimum number of comparisons. 

, For example, if we take a sorted array A [1 — 1], we have to apply 
insertion sort on this array so as to insert element Afi. 

If array A[1. 1] is sorted in increasing order and element A[i] is 
smaller than A[1]in such a condition, we need to make only one comparison 
to find the position of element A[i] in array A[1. 1—i], which is minimum 
number of comparisons in above case, so is a best-case. 


% 29. Explain how time complexity of an algorithm can be calculated. 

Give suitable example, (R.GBV., Dec. 2012) 
Or 

_ How time complexity of an algorithm is calculated ? Explain with 

Sutable example, (R.GR¥., Dec. 2013) 


Ans. Time complexity of an algorithm is the amount of computer time it 
cor a0 Tun to completion. The time T(P) taken by a program P is the sum of 
ame time and run time. Also, a program compiled once can be executed 
ny times without recompiling it. 

The compile time does not depend on the instance characteristics. 

Run time is denoted by t, (instance characteristics). We should concern 
ourself j, e P 

™ computing ty 


need: 
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For calculating the run time of a program we have to calculate ti 
taken in addition, multiplication, subtraction, division, comparison, load, i 
and so on. So, we could obtain an expression for t,(n) as follows — 
t(n) = C,ADD(n) + C,SUB(n) + C,,MUL(m) + C,DIV(n) +... 
Here, n denotes the instance characteristic and C,, C,,, C,, Cy denot 
time needed for an addition, multiplication, subtraction, and division. 
Determining the number of addition, multiplication, subtraction 
different, so we have another way to find time complexity. We count the to 
number of operations. We can count the number of program steps for findi 
execution time which is easier than that of earlier one. The number of steps 
any program depends on the kind of statement. 
Different statements have different counts. 
For example, 
(i) Comments count as zero steps. 
(ii) Assignment statements are counted as one, as they do not cd 
any other algorithm. 
(iii) For iterative statements such as for, while, and repeat-unlj 
statements we count the steps only for control part. 
For example, 
for i: = <exprl> to <expr2> do | 
while (<expr1>) do 
(a) In case of while statement, expression <expr1> has given 
count that is count for step. 
(b) In case of for loop, we have count equal to sum of t 
counter for <exprl> and <expr2>. 
Remaining execution for the for statement have step count of | and so 
When we want to know how the computing time (i.e., time complexil 
increases as the number of inputs increases. In this case, the number of st 
will be computed as a function of the number of inputs alone. 
When we want to know how the computing time increases as th 
magnitude of one of the input increases then we have to find the number 


steps as the function of the magnitude of this input alone. 
So, in above way, step counting will help us in finding time complexi 


Q.10. What are the factors which affect the running time of an algorithm 
(R.GP.V., Dec. 20! 
Ans. Many factors affects the running time of an algorithm or pro; 
Some of them are listed below — . 


() Parallelism —A multi-threaded program running on multicore machil 
will be faster. 
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(ii) CPU Utilization —If CPU is already utilized by some other processes 
then running time of algorithm will increase. 


(iii) VO Bound — Sometimes /O bounds like disk read/write speed 
affect the running time. 


(iv) Overhead Due to many Function Call — There could be huge 
overhead on running if a function call is made multiple times for a small function. 


(v) Recursion — Recursion can cause a lot of overhead which increases 
the running time of an algorithm. 


(vi) Disk Layout — For multiple disk, RAID might work best or faster 
than NAS, SAN or other storage layout. 


(vii) Contention — If there are multiple threads, they are synchronized 
to access common resources, then there can be contention for the resources 
which causes thread to wait. 


(viii) Buggy Synchronization — If there are deadlocks, the algorithm or 
program will stop working or the two threads involved in deadlock will stop. 
This increases running time of any algorithm. 


Q.11. How recursive algorithms are analyzed ? Analyze the execution time 
of recursive algorithm for tower of Hanoi; problem. (R.GP.V., Dec. 2014) 

Ans. The steps to be followed while analyzing recursive algorithms are as 
follows — 

(i) Decide the input size based on parameter n. 

(ii) Identify algorithm’s basic operations. 

(iii) Check how many times the basic operations is executed. 
Thereafter determine the execution of basic operation depends upon the input 
size n. Find worst, average and best cases for input of size n. If the basic 
operation depends upon worst case, average case and best case then that has 
to be analyzed separately. 

(iv) Set up the recurrence relation with some initial condition and 
xpressing the basic operation. 

Whil (v) Solve the recurrence or atleast determine the order of growth. 
’e solving the recurrence we will use the forward and backward substitution 


sy And then correctness of formula can be proved with the help of 
‘athematical induction method. 


aan of Hanoi — There are three pegs namely X, Y and Z. The five 


disks of different diameters are placed on peg X. The arrangement of the 
of tee Such that every smaller disk is placed on the larger disk. The problem 
St of Hanoi states that move the disks from peg X to peg Z using peg Y 
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as an auxiliary. The conditions are — 
(i) Only the top disk on any peg may be moved to any other peg| 
(ii) A large size disk should never be place on smaller one. 


Algorithm 1.1 Tower of Hanoi 


Algorithm TOH(n, X, Y, Z) 
f 
if (n = 1) then //if one disk has to be moved | 
{ 


write(“The peg moved from X to Z”) 
return 


} 


else 


{ 

TOH(n— 1, X, Y, Z); //move top n— 1 disks from X to Y usingZ 

TOH(n - 1, Y, Z, X); //move remaining disk from Y to Z using X 

} 
} 


The tower of Hanoi has a time complexity as 
O(2" = 1) = 0(2"). 
Q.12. Write an algorithm for calculation the fn Fibonacci numeri 
O (log n) time. (R.GRV., June 2012) 
Ans. The algorithm to compute the fn Fibonacci number is as follows — 
Algorithm 1.2 Fibonacci Number 
Algorithm Fibonacci (fn) 
if (fn <1) then 


write (fn); 
else 


fnl = 1; 
fin2 = 0; 
for i=2 ton do 


fn = fnl + fn2; 
fn2 = fnl; 
fnl = fn; 


write (fn); 
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ASYMPTOTIC NOTATIONS 


9.13. What do you understand by the term asymptotics ? 
Or 

What is the significance of asymptotic notations ? (R.GP.V., Dec. 2017) 

Ans. The word asymptotics means the study of functions of a parameter 
n, as n becomes larger and larger without bound. Asymptotic efficiency of 
algorithms is concerned when the input sizes are large enough to make only 
the order of growth of the running time relevant. That is, we are concerned 
with how the running time ofan algorithm increases with the size of the input 
in the limit, as the size of the input increases without bound. For all very small 
inputs, algorithm that is asymptotically more efficient will be the best choice. 

The notations we use to describe the asymptotic running time of an 
algorithm are defined in terms of functions whose domains are the set of 
natural numbers pt = {0, 1, 2. 4 

Such notations are convenient for describing the worst-case running- 
time function T(n), which usually defines only an integer input sizes. 

We can abuse asymptotic notation in variety of ways. For example, the 
notation is easily extended to the domain of real numbers or, alternatively, 
restricted to a subset of the natural numbers. 

0.14, What is the use of asymptotic notations ? (R.GPV., June 2015) 

Ans. Asymptotic notations are used to describe the limiting behaviour of 
a function when the argument tends towards a particular value, usually in 
terms of simpler functions. Generally, we use asymptotic notation as a 
convenient way to examine what can happen in a function in the worst case or 
in the best case. Various asymptotic notations are mostly used for calculating 
the performance or running time of an algorithm. 


Q.15. What is asymptotic notations ? Explain each. (R.GP.V., June 2011) 

Or 
Describe about various types of asymptotic notations used in algorithm 
analysis, (R.GB¥,, Dec. 2011) 


Or 
What is the signi i i ions ? Explain by 
a ignificance of various asymptotic notations ‘P! 
siving examples, (R.GRM, Dec. 2012) 
Or 
What are the different asymptotic notations used ? 
(R.GRV., June 


Explain. 
2014, Dec. 2014) 


Or 
ei What is an asymptotic notations ? Give the different notations 10 used 


“Present the complexity of algorithms. (R.GRY, May 2019) 
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Ans. Refer to Q.13. 
Asymptotic notations are (O, Q, @). 
(i) Big oh (O) Notation — 
The function f(n) = O(g(n)) (read as 
“f of n is big oh of g of n”) iff (if and 
only if) there exists positive constant 

C and ny such that — 
f(n) < C * g(n), for all n, 

nN. 


We use O-notation to give an 
upper bound on a function, to within 
a constant factor, 

For example — 

(a) The function 5n + 4 = O(n) as 5n + 4 < 6n, for all n > 4. 

(b) 6n + 6 = O(n) as 6n + 6 < 7h, for all n> 6. 

(c) 200n + 5 = O(n) as 200n + 5 < 201n, for all n> 5. 

(d) 10n? + 4n + 2 < 11n%, for all n> 5S. 

(e) 1000n? + 100n — 6 = O (n?) as 1000n? + 100n — 6 < 1001n? 
for all n> 100. 

(f) 6*28 + n? = O(29) as 6 * 29 +n? <7 * 2", forn>4. 

(g) 3n + 3 = O(n?) as 3n + 3 < 3n?, forn > 2, 

(h) 10n? + 4n + 2 = O(n*) as 10n? + 4n + 2 < 10n4 or n> 2. 

(i) 3n +2 # O(1) as 3n +2 is not less than or equal to C for amy 
constant C and all n > no. 

Gj) 10n? + 4n +2 ¥ O(n). 

Note — When we write f(n) = O(g(n)), we are merely claiming that ne 
constant multiple of g(n) is an asymptotic upper bound on f(n), with no clai 
about how tight an upper bound is. 

For all values of n to the right of no, the value of the function f(n) is a 
or below. . 

The big oh notation has different meanings depending on different values of 
variable n. Some of them can be stated as follows — 5 

(a) O(1) - Indicates a constant computing time., : 
(b) O(n) — Indicates a linear computing time. és 

(c) O(n?) — Indicates a quadratic computing timé. 
(d) O(n) — Indicates a cubic computing time. 


No f(n) = O(g(n)) 
Fig. 1.1 Intuition Behind O-Notation 


(e) O(2") — Indicates an exponential computing time. 
(f) O(log n) ~ Indicates a logarithmic computing time. 
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(ii) Omega (Q Notation — The function f{n) = O (g(n)) (read as 

“fofn is omega of g of n”) iff there exists positive constant C and nj such that — 
f(n) > C*g(n), for all n, n > np. 

Just as O-notation provides an asymptotic upper bound on a function, 
Q-notation provides an asymptotic lower bound. 

For a function g(n), we denote by Q(g(n)) the set of functions. 

A(g(n)) = {f(n) : there exists positive 
constants C and ng such that 0 < Cg(n) 
< f(n) for all n> No}. 

For example, the function 3n + 2 
= Q(n), as 3n +2 > 3n, forn>1. 

(The inequality holds for n> 0, but the 
definition of Q requires an ny > 0). 

3n +3 =Q(n) as 3n + 3> 3n, forn> 1. 
100n + 6 = Q(n) as 100n + 6 > 100n for 
n> 1. 10n2 + 4n + 2 = Q(n?) as 10n? + 4n 
+2>9, forn> 1. Fig. 1.2 

The intuition behind Q notation is shown in fig. 1.2. 

For all values of n to the right of no, the value of f(n) is on or above g(n). 

(iii) Theta (©) Notation — The function of f(n) = © (g(n)) (read as 
“f of n is theta of g of n”) iff there exists positive constants C,, C,, and no, 
such that C,g(n) < f(n) < C,g(n). 

A function f(n) belongs to the set @(g(n)) if there exists positive constants 
C, and C, such that it can be “sandwiched” between C,g(n) and C,g(n), for 
sufficiently large n. 

Although @(g(n)) is a set, we write 
“f(n) = O(g(n))”. 

Fig. 1.3 gives intuitive picture of 
function f(n) and g(n), where f(n) 
= en), 

For all values of n to the right of no, 
the value of f(n) lies at or above C,g(n) 
and at or below C,g(n). 

Ih other, words, for all n > np, the 
function fin) is equal to g(n) to within a 
©onstant factor. 

We say, that, g(n) is an asymptotically tight bound for f(n). 


Ag f(n) =2 (gn) 


Np f(n) =O (en) 
Fig. 1.3 
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The function 3n + 2 =@(n) as 3n + 2>3n foralln >2and3n+ 2<4y 
for all n > 2, so C, = 3, C= 4, and ny = 2. 

3n +3 = O(n), 10? + 4n + 2 = @(n2), 
6 * 29+ n? = @(25), and 
10 * logn +4 = O(log n) 

So, theta notation is more precise than both the big oh and omega notations, 

The function f(n) = O(g(n)) iff g(n) is both an upper and lower bound of f(n), 


9.16. Give the definition of Big “oh” with example, 


(R.GPV, June 2016) 
Ans. Refer to Q.15 (i). 


0.17. Define Q notation. 
Ans. Refer to Q.15 (ii). 


0.18. What are the differences between big-oh (O), omega (a) ant! 
theta (@) notations ? (R.GPM, June 2017) 


Ans, Refer to Q.15. 


0.19. Why do we use asymptotic notations in the study of algorithms ? 
Briefly describe the commonly used asymptotic notation, (R.GPV., Dec. 2016) 


Ans. Refer to Q.14 and Q.15. 


0.20. Briefly describe the asymptotic notations used in the study of 
algorithms, Also write the relational properties of the asymptotic notations, 
(R.GPV., Nov. 2018) 


(R.GP.M, June 2015) 


Ans. Refer to Q.15. 
The relational properties of real numbers apply to asymptotic comparisons, 
Suppose that f(n) and g(n) are asympotically positive. 
Transitivity — 
f(n) = ©(g(n)) and g(n) = ©(h(n)) imply fn) = O(h(n)), 
f(n) = O(e(n)) and g(n) = O(h(n)) imply fn) = O(h(n)), 
f(a) = Q(g(n)) and g(n) = Q(h(n)) imply f{n) = A(h(n)), 
fin) = o(g(n)) and g(n) = o(h(n)) imply fin) = o(h(n)), 
f(n) = @(e(n)) and g(n) = o(h(n)) imply f{n) = o(h(n)). 


Reflexivity — 
f(n) = @(f(n)), 
fin) = O(f(n)), 


fn) = Q(f(n)). 
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Symmetry — : 
f(n) = ©(g(n)) if and only if g(n) = @(f(n)). 

TJranspose Symmetry — 
f(n) = O(g(n)) if and only if g(n) = Q(f(n)), 
f(n) = o(g(n)) if and only if g(n) = a(f(n)). 

Because these properties hold for asymptotic notations, one can draw an 
analogy between the asymptotic comparison of two functions f and g and the 
comparison of two real numbers a and b — 

f(n) = O(g(n)) = a <b, 
f{n) = Q(g(n)) = a2 b, 
f(n) = O(g(n)) ~ a = b, 
f(n) = o(g(n)) = a <b, 
f(n) = w(g(n)) = a > b. 

0.21. Define [little “oh”] “o” notation, 

Ans. The asymptotic upper bound provided by o-notation may or may 
not be asymptotically tight. The bound 2n? = 0(n2) is asymptotically tight, but 
the bound 2n = 0(n?) is not. 

We use o-notation to denote the upper bound that is not asymptotically tight, 

We formally define o(g(n)) (“little-oh of g of n”) as the set. 

0(g(n)) = {f(n) : for any positive constant C > 0, there exists a constant 
Ny > O such that 0 < f(n) < C g(n) for all n > no}. 

2n = 0(n2), but 2n? ¥ o(n?). 
f(n) = o(g(n)) iff 


For example, 
The function 


tim £0) _ 
no g(n) 
Example — The function 3n +2 = o(n?) 
Since Lim 3n+2 =0 
n>o n 


3n +2 =0o(n log n) 
3n + 2 =o(n log log n) 
6 * 29 + n2 = 0(39). or 
ae The definitions of O-notation and o-notation are sare 5) ela 
Cut in f(n) = O(g(n)), the bound 0 < f(n) < Ce(n) holds foi 0. 
C>O, but in f(a) = o(a(n), the bound 0 <f{n) <Ca(n) holds, forall constant C> 0. 
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Intuitively, in the o-notation, the function f(n) becomes insignificany 
relative to g(n) as n approaches infinity — 
f(n) _ 0. 


i im —— 
that is, n> g(n) 


Q.22. Define [little omega] “a” notation. 


Ans. By analogy, @-notation is to 2-notation as o-notation is to O-notation, 
We use -notation to denote a lower bound that is not asymptotically tight. I 
can be defined as — 
f(n)€a(g(n)) if and only if g(n) €0(f(n)). 
Formally, we define w(g(n)) (“little-omega of g of n”) as the set. 
@(g(n))= {f(n) : for any positive constant C > 0, there 
exists a constant ng > 0 such that 0 < Cg(n) < f(n) for all n > np}. 


2 2 
=a) , but ae a(n’). 


For example, 
The relation f(n) = @(g(n)) implies that 
lim £00) _ . if the limit exists. 
n— oo g(n) 


Thats, f(n) becomes arbitrarily large relative to g(n) as n approaches infinity. 


0.23. Write in brief about the significance of the following notations — 
@ ‘0’ (ii) ‘Q (iii) ‘8 (iv) 0” (v) a” 
(R.GP.M¥., Dec. 2013) 

Ans. Refer to Q.15, Q.21 and Q.22. 

Q.24. Explain the variation of the rate of growth of common computing 
Sunctions. 

Ans. Time complexity of an algorithm is generally some function of the 
instance characteristics. This function is very important in determining how 
the time requirements vary as the instance characteristics change. Also, the 
complexity function can be used to compare two algorithms P and Q that 
perform the same task. Now suppose that algorithm P has complexity @(n) 
and algorithm Q has complexity @(n?). Here we can assert that algorithm P is 
faster than algorithm Q for sufficiently large n. To confirm the validity of this 
assertion, observe that the computing time of P is bounded from above by cn 
for some constant c and for all n, 2 2n, whereas that of Q is bounded from 
below by dn? for some constant d and all n, 2 2n, As cn Sdn? forn 2c, 
algorithm P is faster than algorithm Q whenever n > max {n,, n,, c/d}. 
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32 64 128 


24 8 16 
Fig, 1.4 Rate of Growth of Common Computing Time Functions 
Figs. 1.4 and 1.5 describe how the computing times (counts) grow with 
a constant equal to one. Here it should be noticed that how the times O(n) and 
O (n log n) grow much more slowly than the others. For large data sets, 
algorithms with a complexity greater than O (n log n) are often impractical. An 
algorithm which is exponential will work for only small inputs. Even for 
exponential algorithms, if we improve the constant, say by 1/2 or 1/3, we will 
not improve the amount of data, we can handle, very much. 


logan n nloggn n? a 2 
0 1 0 1 1 2 
1 2 2 4 8 4 
2 4 8 16 64 16 
3 8 24 64 S12 256 
‘4 16 64 256 4096 65536 
5 32 160 1024 32768 4,294,967,296 


Fig. 1.5 Values for Computing Functions 
Now, an algorithm is given. We analyze the frequency count of each 
Statement and total the sum. This may give a polynomial 
P(n) = onk +e, nk +... + ey + Cy 
Where the c, are constants, c, #0 and n is a parameter. Using big-oh notation, 
P(n) = O(n'),.On the other hand, if any step is executed 2* times or more the 
expression 
2" + P(n) = O(2") 
Another important performance measure of an algorithm is the space it 
Feduites, Gerierally one can trade space for time, getting a faster algorithm but 
“Sing more space, 
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NUMERICAL PROBLEMS 


Prob.1. Find the O-notation for the function — 
Sn) = Sn +n? + 3n+2 (R.GPV, June 2011) 
Sol. The function 5n3 + n? + 3n + 2 = O(n) as Sn? + n? + 3n +2 < 6n3 
for all n 2 3. 
Dc TAO NE SNS AIST ES SIRT EROS AEA SET) 
HEAP AND HEAPSORT | 
(ce a 
Q.25. Define heap. (R.GP.V., Dec. 2011) 
Ans, A max (min) heap is a complete binary tree with the property that 
the value at each node is at least as large as (as small as) that values at its 
children (if they exist).We call this property heap property. Many operations 
can be performed on a heap. 
0.26. Give all the steps to convert the following complete binary tree 
into heap (max). (R.GP.V., May/June 2006) 
Ans. The procedure of heapify is as follows — Create a heap out of the 8 
elements. The sequential steps are given below — 
(i) The initial tree is shown in fig. 1.6, since n= 8, the first step to 
adjust has i = 3 in fig. 1.7 (a). 


Fig. 1.6 

(ii) The tree elements 4, 5 and 9 are again arranged to form a heap 
in fig. 1.7 (b). 

(iii) Again we see that i= 1 is smaller, than i= 3, then interchange 
i=1andi=3 as in fig. 1.7 (c). 

(iv) Now in left subtree interchange i = 1 to i = 2 as shown in 
fig. 1.7 (d). 

(v) As shown in fig. 1.7 (d) i =2 is smaller than i = 4 (12) than 
change the position to each other. 

(vi) We get fig. 1.7 (e). Again applying same rules we get fig. 1.7 (1) 

(vii) Now in fig. 1.7 (e), only two elements are in left subtree that is 
not in correct order according to max heap. So rearrange them. 

(viii) At last, we have a complete heap tree shown in fig. 1.7 (g). 
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0.27. Show that an n-element heap has height [log nj. 
(R.GPV, June 2010) 

Ans. In order to show this let the height of the n-clement heap be h. From the| 

bounds obtained on maximum and minimum number of elements in a heap, we get 
a<ns2hl—1 

where n is the number of elements in a heap. 
2<ns2 

Taking logarithms to the base 2 

h<logyn<sh+1 

It follows h = Llonyn. 

We known from above that largest element resides in root, A[1]. The natural 
question to ask is where in a heap might the samllest element resides ? Consider 
any path from root of the tree to a leaf. Because of the heap property, as we 
follow that path, the elements are either decreasing or staying the same. If i 
happens to be the case that all elements in the heap are distinct, then the above 
implies that the smallest is in a leaf of the tree. It could also be that an entire 
subtree of the heap is the smallest element or indeed that there is only one 
element in the heap, which in the smallest element, so the smallest element is} 
everywhere. Note that anything below the smallest element must equal the} 
smallest element, so in general, only entire subtrees of the heap can contain 
the smallest element. 

Q.28. How insertion is done in a heap ? Explain and give its algorithm 
and complexity. 
Ans. Suppose that H is a heap with n elements, and an item of informations] 
is given.Then, this insertion into heap can be done as follows — 
(i) Adjoin item at the end of H so that H is still a complete tree, bu 
not necessarily a heap. 
(ii) Then, let item rise to its “appropriate place” in H so that H is 

finally a heap. 
Suppose we have a given heap as shown in fig. 1.8. 

97 


a 95 
yf ‘ JL Se 
66 35 7% ras Ls 


wae “ 


18 40 30 2624 
Fig. 1.8 Heap 
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The sequential representation of above heap is shown in fig. 1.9. 


394 5 6 7 8 9 10 11 12 13 14 15 16°17 18 19 20 

Fig. 1.9 Sequential Representation 

Now we add item 70 to above heap. For this we add 70 at next element 
position only, i.e., at position 21, Now, the heap will look like fig. 1.10 (a). We 
have to find the appropriate place of 70 in heap, for this we do — 

(i) Compare 70 with its parent element, i.c., 48 in our case. If parent 
element is less than 70 then interchange the position. Otherwise we have 
come to know the right position, 

Here, 48 < 70, so interchange the position as shown in fig. 1.10 (b). 

(ii) Now, compare 70 with its new parent 55. Since 70 is greater 
than 55, interchange 70 and 55 the path will look like fig. 1.10 (c). 

(iii) Compare 70 with 88. Since 70 does not exceed 88, item = 70 
has risen to its appropriate place in H. 

97 97 97 


# 


18 40 30 26 24 48 
@ 
Fig. 1.10 Insertion into a Heap 
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The algorithm for insertion into a heap can be given as follows — 
Algorithm 1.3 Insertion into a Heap 
1 Algorithm Insert(a, n) 


2 { 

3 // Inserts a[n] into the heap which is stored in a[1:n — 1]. 
4 i:=n; item :=a[n]; 

5 while((i > 1) and (a (Li/2 J] < item)) do 

6 

7 afi) = aflv2.); i =Li25; 

8 } 

9 a{i] = item; return true; 

10 } 


Complexity —If there are n elements in the heap inserting a new element 


takes O(log n) time in the worst case. 
0.29. Explain how deletion can be performed from a heap. 


Ans, To delete the maximum key from the heap, we use an algorithm 


called adjust. 


Suppose H is a heap, with N elements, and we want to delete the root R 


of H. This can be done as follows — 
(i) Assign the root R to some variable item. 


(ii) Replace the deleted node R by the last node L of H so that H is 


still a complete tree, but not necessarily a heap. 


(iii) (Reheap) L sink to its appropriate place in H so that H is finally a heap. 


Deletion can be understood by following example. 
Let we have to delete root node 95 from heap given in fig. 1.11. 


70 
/\ \ 
i, 7°" eS pee 
15 20 15 15 20 15 
© @ 
Fig. 1.11 Deletion from a Heap 
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We delete node 95 from heap and put last node in its place, i.e., place 22 
in place of 95. 
Now we have a complete tree but not a heap, For this we have to heapify 
it. This can be done by following steps — 
(i) Compare 22 with its children and interchange its position with 
largest child greater than 22. So, we replace 22 and 85. 
(ii) Again repeat above step with 22, and replace 22 with 55. 
(iii) Again we do the same, but this time 22 is greater than both of its 
children, so no conversion is required, 
Complexity — If there are n elements in a heap, deleting the maximum 
can be done in O(log n) time. : 


0.30. Explain heapsort algorithm with example. 
(R.GPV., June 2009, Dec. 2011, June 2013) 


Ans, Suppose an array A with N elements is given. The heapsort algorithm 
to sort A consists of the two following phases — 

Phase A — Build a heap H out of the elements of A. 

Phase B — Repeatedly delete the root element of H. 

Heapsort algorithm can be given as follows — 


Algorithm 1.4 Heapsort Algorithm 


1 Algorithm HeapSort(a,n) 

2  //a{l:n] contains n elements to be sorted. HeapSort 
3 // rearranges them inplace into nondecreasing order. 
4 

5 Heapify (a, n); // Transform the array into a heap. 
6 // Interchange the new maximum with the element 
7 // at the end of the array. 

8 for i:=n to 2 step—1do 

9 

10 t = afi); afi] := a[1); a1] =t 

ll Adjust (a, 1, i— 1); 

1 

13 } 


Example — Refer to Prob.4. 


2.31. What is the time complexity of heapsort ? Justify your answer. 
(R.GP.V., May/June 2006) 
Ans. Heapsort requires time O (n jog n). A sorting algorithm incorporates 
the fact that n elements can be inserted in O (n) time. Though the call of 
Heapify requires only O(n) operation. Adjust requires O (log n) operations for 
each Invocation. 
Thus, the worst time is O (n log n). 
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f NUMERICAL PROBLEMS 


Prob.2. Following nodes are inserted in empty tree, to form minimum 
heap. With neat sketches show how insertion will be done. 
Gy Ko EAs Gpdy Api Dy ae 
(R.GP.V., May/June 2006, June 2014) 
Sol. The given data array is 


We have 8 elements to insert in empty tree, fig. 1.12 shows how the data 
move around until a heap is created. 


~ oo ok 


ff 
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Fig. 1.12 


Prob.3. Sort the following list using heapsort — 
66, 33, 40, 20, 50, 88, 60, 11, 77, 30, 45, 65 
Also discuss the complexity of the heapsort. (R.GPV. Dec. 2016) 


Sol. Fig. 1.13 shows the creation of heap for the given list of keys — 


(6s) (65) 


(a) Heap Size 1 (b) Heap Size 2 (c) Heap Size 3 
(60) (66) (64) 
0) @) ©) @) @) 
(d) Heap Size 4 (©) Heap Size 5 


(6) @ Gs) (s) 
Y ©O-@ @O©-@ © @® @ 
OO@® @O®@ @©O@ OOGO@ 


@) Heap Size 6 (g) Heap Size 7 


(h) Heap Size 8 
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OO@OMS @ 
() Heap Size 12 

Fig. 1.13 Creation of Heap 

Fig. 1.14 shows processing of heap. 


© @ 


) Heap Size 10 


“663477 {883 


(i) Heap Size 4 


(e) Heap Size 8 
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@) 


@) Heap Size 3 
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(m) Sorted thaws 
Fig. 1.14 


Prob.4. Illustrate heapsort on the array — 
A=[5, 8, 3, 9, 2, 10, 1, 40] (R.GP.V., Dec. 2015) 


Sol. Fig. 1.15 shows the creation of heap for the given list of keys — 


o é 6 66 


(a) Heap Size 1 (b) Heap Size 2 (c) Heap Size 3 


Fig. 1.16 shows the processing of eo 


(d) Heap Size 4 (e) Heap Size 5 @ Heap Size 6 


(g) Heap Size 7 (h) Heap Size 8 
Fig. 1.15 Creation of Heap 


Unit-1 29 


30 Analysis & Design of. Algorithm (B.E., 1V-Sem.) 


Prob.5. Illustrate the operation of 


= 5, 13, 2 25, 7, 17, 20, 8 4] 
a (R.GRV., Nov. 201 


Sol. Fig. 1.17 shows th 


o) 


(a) Heap Size 1 (b) Heap Size 2 


(@) Heap Size 4 


(5) (25) 
Qa O-@® WM 
OOO OOO 


() Heap Size 6 


(13) (25) (5) 
Gg ©-® © G) © 
G5) ©) © © 


(e) Heap Size 5 


heapsort on the array — 
e creation of heap for the given list of keys ~ 


“~§ ob 


(c) Heap Size 3 


(25) (25) 
Q MA-Q 
©OOO OO OO © 


(g) Heap Size 7 


Q Q @Q 
Oo @®@-@® @ Oo | 
CLOLOLOMOLOLORO MEE OROLONS 
© © ©O® 


(h) Heap Size 8 
Fig. 1.17 Creation of Heap 


(i) Heap Size 9 
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INTRODUCTION TO DIVIDE AND CONQUER TECHNIQUE, 
ANALYSIS, DESIGN AND COMPARISON OF VARIOUS 
ALGORITHMS BASED ON THIS TECHNIQUE, EXAMPLE 
BINARY SEARCH, MERGE SORT, QUICK SORT, STRASSEN’S 
MATRIX MULTIPLICATION 
(ee 

0.32. What is divide and conquer strategy ? Write and explain the 
algorithm of divide-and-conquer. (R.GPV., Dec. 2012) 

Ans. Consider a problem P associated with a set S. Suppose A is an 
algorithm which partitions S into smaller sets such that the solution of the 
problem P for S is reduced to the solution of P for one or more of the smaller 
sets. Then A is called a divide-and-conquer algorithm. 

In other words, divide-and-conquer strategy suggests splitting the input 
into k distinct subsets, 1 <k <n, yielding k subproblems. These subproblems 
must be solved separately and, then a method must be found to combine 
subsolutions into a solution of the whole. 

The divide and conquer paradigm involves three steps at each level of the 
recursion, 

Divide — Divide the problem into number of subproblems. 

Conquer — Conquer the subproblems by solving them recursively. If the 
subproblems sizes are small enough, just solve the subproblems in a 
straightforward manner. 

Combine — Combine the solutions of the subproblems into the solution 


for the original problem. 
In cases where main problem and subproblems are of same type, then 


divide-and-conquer principle is naturally expressed by a recursive algorithm. 
Three examples of the divide and conquer algorithms are — 
(i) Binary search algorithm 
(ii) Mergesort algorithm 
(iii) Quicksort algorithm. 

Algorithm — By a control abstraction we mean a procedure whose flow 
of control is clear but whose primary operations are specified by other 
procedures whose precise meanings are left undefined. DAndC (algorithm 
1.5) is initially invoked as DAndC(P), where P is the problem to be solved. 

: Small(P) is a boolean-valued function that determines whether the input 
size is small enough if so, then the answer can be computed without splitting. 

If its value is true means problem is small enough and can be easily 
solved. If its value is false means problem is not small enough and it should be 


partitioned into smaller problems. 
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These subproblems P}, P3,....P;, are solved by recursive applications 


DAndC. 
At the end, Combine is a function that determines the solution to P 
the solutions to the k subproblems. 

If the size of problem P is /, and the sizes of k subproblems are } 
»h,, respectively, then the computing time of DAndC is described 
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Algorithm 1.6 Recursively Finding the Maximum and Minimum 
1. Algorithm MaxMin(i, j, max, min) 
2. // a{1 : n] is a global array. Parameters j and j are integers, 
3. // 1 Si Sj <n. The effect is to set max and min to the 
4, // largest and smallest values in afi; i], respectively. 


y ener 5. 
the recurrence relation Pee ¢ 
a(1) Ismail 6. if (i = j) then max := min := afi); // Small(P) 
TOD V1 (hy) + Tp) penevecssansn 4T(I,)+£(0) otherwise] 7. else if (i =j — 1) then // Another case of Small(P) 

Here, g(/) is the time to compute answer directly. : { if (a[i] <alj)) then 

F()) is the time for dividing P and combining the solutions to subprobl 10. { 

T(J) is the time for DAndC on any input of size /. il. max :=a[j]; min = afi]; 

The complexity of many divide-and-conquer algorithms is given 12. } . , 

recurrences of the form 13. else 
TQ) n=1 14. { 
T(n) = ar(2) ata) ail 15. max := a[i]; min = alj]; 
b 16. } 
Here, a and b are constants. a7. } 
Here, we consider that value of T(1) is known, and n is defined as 18. else 
of b (i.e., n = bY), , . 19. { //IfP is not small, divide P into subproblems. 
This complexity can be found by solving above recurrence relation. 20. // Find where to split the set. 
of the method is substitution, 21. mid =L(i +25 
Algorithm 1.5 Divide-and-conquer Algorithm 22. // Solve the subproblems. 
1. Algorithm DAndC(P) 23. MaxMin(i, mid, max, min); 
2: 24. MaxMin(mid + 1, j, max1, min1); 
3 if Small(P) then return S(P); 25. // Combine the solutions. 
4 else 26. if (max < max1) then max := max]; 
5. { _ ; ' 27. if (min > min1) then min := min]; 
6 divide P into smaller instances P,, P5,....,P,, k 2 1; 28. } 
7. Apply DAndC to each of these subproblems; 29.} 
8 return Combine (DAndC(P,), DAndC(P,),...., DAndC(Py : 
9 } 2.34. What is the data structures used to perform recursion ? 
(R.GP.V., Dec. 2016) 


10. } 
: ae : ith Ans, Stack is used in recursion. Because the stack have the property of 
0.33. Explain the divide and conquer technique. Write an algorit! mm) last in first out (LIFO) which is required to store the current state of function 
find the maximum and minimum element in an array using this a and jump to new instance of that function. So that when the execution of new 
(R.GPY, Dec. instance get over, it jump back to its previous instance. 


Ans. Divide and Conquer Technique — Refer to Q.32. 
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0.35. Explain briefly binary search technique. 

° Or 

tion that can be solved by divide and cong 
(R.GP.V, Dec. 2), 


‘Ans. Leta;, 1 <i<n,bea list of elements that are sorted in nondec: 
order. Now, consider the problem of finding whether a given element x 
present in the list. If x is present, we are to determine a value j such 

_= x, Ifx is not in the list, then j is set to zero. Let P= (n, aj, «...5 @y, X) de 
an arbitrary instance of the above problem where n is the number of ele: 
in the list, aj, ..., a, is the list of elements, and x is the element searched 

Divide and conquer technique is used to solve this problem. Consider 
(P) be true, ifn = 1. In this case, S(P) will take the value i ifx =a; ; otherwise it 
take value 0. Then g(1) = @(1). If P has more than one element, then it can} 
further divided into a new subproblem as follows. Pick an index q (in the rangy 
1}) and compare x with ag. There are three possibilities that can occur — 

(i) x= aq: In this case the problem P is immediately solved. 
(ii) x<ag : In this case x has to be searched for only in the sublist 
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Table 1.1 Three Examples of Binary Search on 14 Elements 


Explain any one applica 


Aj) s+) Ag. Therefore, P reduces to (q — i, aj, «...., @g-1+ x). 
ii) x > ag : In this case the sublist to be searched is q+), ---» 4 : 
reduces to (I — q, Seas sassy py X)- 0.38. What is the complexity of binary search algorithm ? 


Ans. Binary search technique is beneficial to use when data in an array is 
stored in increasing numerical order, or equivalently alphabetically, 
The complexity of any algorithm is measured by the number f(n) of 
comparisons to locate ITEM in DATA where DATA contains n elements. 
2 binary bare! each comparison reduces the sample size in half. 
uppose f(n) is the maximum number of co: i i 
feat pak bien mparisons required to locate 
2f() > n or 
we can say, 
_ f(a) = [logon] + 1. 
i.e., the worst time complexity is apj i 
t proximately equal to logsn. In th 
} best ws samblentty can be given as 6(1). ‘nadie 
S in the best case, we find that the data item for which we a i 
rc i > re 
is the middle term of the data segment. pita 
So, in the first compari i i i 
. parison we will result with required location, i 
MID of data segment. So, the best case complexity is (1). rane 
Ste eee case complexity in successful search can be given as 
- While, in unsuccessful search, complexity i 
MGR res plexity in all best, average, and 
Finally, complexity of binai ithm in di 
. ;, ry search algorithm in different types of. h 
@ie., successful search and unsuccessful search) can be Fb as — — 


In this example, the problem P gets divided into one new subprob! 
This division takes only (1) time. After a comparison with ag, the i 
remaining to be solved (if any) can be easily solved by using divide 
conquer technique again. If q is always chosen such that a, is the i 
element (that is q=L(n + 1)/2), then the resulting search algorithm is 
binary search. Here point to be noted is that the answer to the new subprol 
is also the answer to the original problem P, there is no need for any combi 


0.36. How divide and conquer technique can be applied to binary 
Also write algorithm for divide and conquer. (R.GPV., June 2015, 2! 


Ans. Refer to Q.35 and Q.32. 


0.37. Give example of binary search technique. 
Ans. Let we have the following 14 data items — 

—15,—6, 0, 7, 9, 23, 54, 82, 101, 112, 125, 131, 142, 151 and 
them in a [1 : 14], and simulate the steps that BinSearch goes through 
searches for different values of x. The variables low, high and mid need 
only traced when we execute the algorithm. We try the following valu’ 
151, — 14 and 9 for two successful and one unsuccessful search. Table! 
explains the traces of BinSearch on these three inputs. 


36 Analysis & Design of Algorithm (B.E., 1V-Sem.) 


Successful Searches — 


Best Case (1) 
Average Case [log n] 
Worst Case O[log n]. 
Unsuccessful Searches — 
Best Case Oflog n] 
Average Case @[log n] 
Worst Case Oflog n] 


0.39. Implement an algorithm for binary search. Discuss in detail al 
time complexity of binary search algorithm. (R.GP.V., May 20}, 
Ans, Implementation of an Algorithm for Binary Search — Refer to 
Time Complexity of Binary Search Algorithm — Refer to Q.38. 
0.40. Write and explain an algorithm to search an item in array 
divide and conquer strategy with complexity O(log n). (R.GP.V., Dec. 20) 
Ans. Refer to Q.32 and Q.38. 
0.41. Give the divide and conquer solution for binary search and an a hk 
its complexity. (R.GP.V., May 20) 
Ans. Refer to Q.35 and Q.38. 
0.42. Explain divide and conquer technique. Design a recursi 
algorithm for binary search. (R.GR.V., June 2009, 201 
Ans. Divide and Conquer Technique — Refer to Q.32. 
Recursive Algorithm for Binary Search — Algorithm 1.7 describes 
recursive binary search procedure, where BinSreh has four inputs a [ J, 
and x. It is initially invoked as BinSrch (a, /, n, x). 


Algorithm 1.7 Recursive Binary Search 


1. Algorithm BinSrch (a, i, /, x) 

2. //Given an array a [i; J] of elements in nondecreasing. 
3. /Order, 1 <i </, determine whether x is present, and 
4. //if so, return j such that x =a [j]; else return 0. 

5. { 

6. if (7 =i) then // If small (P) 

1. { 

8. If (x = a[i]) then return i; 

Ds else return 0; 

10. } 

11. else 
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12. {// Reduce P into a smaller subproblem. 


13. mid : = [(i + )/2]; 

14. if (x = a [mid]) then return mid: 

15. else if(x<a[mid]) then 

16. return BinSrch (a, i, mid — 1, x); 

17: else return BinSrch (a, mid +1, 1, x); 
18. } 

19. } 


Q.43. Discuss in which condition binary search is better than linear 
search. (R.GRV, June 2016) 
Ans, Binary search is an efficient searching method. While searching the 
elements using this method the most essential thing is that the elements in the 
array should be sorted one. The binary search algorithm becomes relatively 
more efficient when the number of components on the list is large. Binary 
search is more efficient than linear search because it requires less number of 
comparisons. ° 
; Sequential search (or linear search) is easy to write and efficient for short 
lists, but a disaster for long ones. Imagine trying to find the name in a large 
telephone book by reading one name at a time at the front of the book. To find 
any item in a long sorted list, there are far more efficient methods, One of the 
best is binary search, in which first to compare the item with one in the center 
of the list and then restrict our attention to only the first or second half of the 
list, depending on whether the item comes before or after the central one. In 
Bee at each step we reduce the length of the list to be searched by half. 
nly twenty compari: is il i 
cass ais ee this method will locate any requested name in a 


0.44. What are the limitations of binary search algorithm ? 
Ans. The algorithm requires two conditions — 
(i) The list must be sorted and 
; di) One must direct access to the middle element in any sublist. 
ia hs Ae that one must essentially use a sorted array to hold the data, 
‘ian feet lata an a sorted array is normally very expensive when there are 
diteesteuts ms ani deletions. In such situations, accordingly, one may use a 
structure, like linked list or a binary search tree, to store the data. 
2.45. Write a short note on mergesort. (R.GPR.V., Dec. 2016) 
Ans. MERGING — Suppose A is a sorted list with r elements and B is a 


| Sorted list with s elements, 


list ae Operation that combines the elements of A and B into a single sorted 
with n =r + s elements is called merging. 
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The mergesort closely follows the divide-and-congy 


esort — 
fat it operates as follows — 


A itively, 
aradigm. Intuitively, 
. Divide the n elements sequence to be sorted into tn 


Divide — 
subsequences of n/2 elements each. 
Conquer — Sort the two subsequences recursively using mergesort, 


Combine—Merge the two sorted subsequences to produce the sorted ed 


one thing is to be noted that the recursion “bottoms out” when 
gth 1, in which case there is no work to 


f length 1 is already in sorted order. 


Here, 
sequences to be sorted has len: 
done, since every subsequence 0 

Merging of two sorted subarrays can be done as follows — 

Suppose one is given two sorted decks of cards. The decks can be mergy 


as shown in fig 1.18. 


a 
ZA 
‘ama! 7 
i is 


(b) 


(2) @ 
Fig. 1.18 Merging of Two Sorted Arrays 
In each step of merging two sorted subarrays, two front cards 
compared and the smaller one is placed in the combined deck. 
As in fig. 1.18 (a) front cards 22 and 33 are compared, but 22 < 33 59) 
is placed on combined deck. 
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In each step we do the same i.e., in next step we compare 44 and 33 and 44 
> 33, so 33 is placed in the combined deck as shown in fig. 1.18 (b) and so on. 
When one of the deck is empty, all the remaining cards in the other deck 
are put at the end of the combined deck. 
And finally we result with a sorted array. 
Q.46. Write Mergesort algorithm and analyse your algorithm of 
different case. 
Ans. Mergesort algorithm is given in algorithm 1.8. 
Algorithm 1.8 MergeSort Algorithm 
1, Algorithm MergeSort(low, high) 
2. //a[low : high] is a global array to be sorted. 
. // Small(P) is true if there is only one element 


3 
4. // to sort. In this case the list is already sorted. 
5. { 

6. if (low < high) then // If there are more than one element. 
7.@ { 

8. // Divide P into subproblems. 

9, // Find where to split the set 

10. mid := L(low + high)/2]; 

ll. // Solve the subproblems. 

12. MergeSort(low, mid); 

13. MergeSort(mid + 1, high); 

14, // Combine the solutions. 

15, Merge(low, mid, high); 

16. } 

i § 


Algorithm of merging two sorted subarrays is given in algorithm 1.9. 
Algorithm 1.9 Merging Two Sorted Subarrays, Using Auxiliary Storage 
1. Algorithm Merge(low, mid, high) 

+ Hatlow : high] is a global array containing two sorted 

Ht Subsets in aflow : mid] and in a{mid + I : high]. The goal 

ad is to merge these two sets into a single set residing 

+ “in allow : high]. b{] is an auxiliary global array. 


Nv 


h = low; i := low; j = mid + 1; 
while((h < mid) and (j < high) do 
{ 
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10. if(a{h] < a[j]) then 
MW. { 
12; bii] = ah]; h =h+1; 


wm | 

14. else 

1 

16. bi) = afi} j =i +1 
m F 

18. i=i+l,; 


19. } 
20. if(h> mid) then 
21. for k :=j to high do 


22; { 

23. bfi] = alk); i= i+ 1; 

24. 3} 

25. else 

26. for k =h to mid do 

nm ff 

28. bfi] := a[k]; i =i+ 1; 

29. } 

30. for k := low to high do a[k] := b[k]; 
31. 


Refer to Q.48 for analysis of complexity. 


0.47. Write the mergesort algorithm and discuss its efficiency. Sort} 

E, X, A, M, P, L, E in alphabetical order using mergesort. 
(R.GPV., May 20) 
Ans. Mergesort Algorithm — Refer to Q.46. 
Efficiency of Mergesort Algorithm — The computer takes a time 
produce the output for a given input, according to the designed algorithm 
a specific task. The computing efficiency is more important for an algori 
it calculate the total time taken by the computer to perform a task. For exal 
if computer A is 1000 times faster than computer B, means computef 
processes | billion of instructions per second, and computer B process*} 
million of instructions per second. If we run the selection sort algorithm 
the order of growth at n? and the another sorting algorithm called the ‘me: 
algorithm’ with the order of growth at n logon. The mergesort algorithm 
be more efficient as compared to any other algorithm. If we run both algoti! 
to sort I million of values in an input array, the mergesort algorithm is 

efficient, it takes less time and produce the output. 
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Let we have to sort data array 


E, X, A,M, PL, E 
eoeye 


Finally the sorted data is A, E, E, L, M, P, X. 


0.48. Evaluate the time complexity of mergesort. 

Ans. In mergesort our recurrence-based analysis is simplified if we assume 
that the original problem size is a power of two i.e., n = 2k, Where n is total 
number of elements in array, and k is some constant. 

Each divide step yields two subsequences of size exactly n/2. 

Mergesort on just one element takes constant time. But when we have 
n> | elements, we break down the running time as follows — 

Divide — The divide step just computes the middle of the subarray, which 
takes constant time. 2 

i.e., O(1) when n= 1. 


Conquer — We recursively solve two subproblems, each of size = » Which 


contributes n(2) to the running time. 


Combine — Merge procedure on an n elements subarray takes time @(n), 


so C(n) = @(n). 
So, the worst case running time T(n) of merge sort is given as — 
@(1) ifn=1 


Ta)= ni(3) +O(n) ifn>1" 


We solve above complexity by substitution method so as to find actual 
complexity, 
(1) and @(n) indicate some constant value, with @(n) some function of 
n, let C.n. So, we can write complexity function T(n) as follows — 
Put @(1)=a and ©(n)=Cn 
a n=1 


T(n) = ar(2)+ Cn n>1 
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Here, a and C are constant and n= 2k, 


T(n) = an2)+ Cn 


Substituting value of 3 
2 


T(n)= af 


= 213 }r202 +C.n = 2? (3 }+2Gn 


T(n) = x[n(3)+c 
2 2 


T(n)= 213 }+3 Cn 
2 


+C. S]cn 


&\|5 


N 


Again substitute value of T 


Qs 


+ jee 


(k— 1) term can be given as — 
= 9k-1 n 
T(n) = 2 {35 } +(k=1).C.n 
Similarly, kth term can be given as — 


T(n) = aa }+kcn 


We know that =n = 2k 
Substituting value of n 


ak 
T(n) = are r}eKea =2kT(1) + k.C.n. 


We know that when 


n= 1, T(1) =a. 
So, T(n)=2ka+kC.n, 
also n=2k 
So, Tn)=an+kCn, 


We can also write 


k= logon [-- n = 2k] 
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So, T(n)=a.n +n.C, logyn 


or, we can write T(n)= @(nlog, n) 
ie., complexity as a function of n log, n. 

So, the complexity of mergesort algoirthm can be given as — 

@(nlog, n). 

0.49. Explain mergesort algorithm with example. 

Ans. Refer to Q.46. 

Let we have to sort data array — 

A= (5; 2, 4, 6, 1, 3, 2, 6) by applying mergesort algorithm. 

This can be done in the following steps — 

(i) Divide the array in two subarrays of size n/2, i.e., 4. 
We result with two unsorted subarrays. 
(5, 2, 4, 6) and (1, 3, 2, 6). 
(ii) Now, again apply mergesort for sorting subarrays separately, 
resulting in 4 unsorted subarrays 
(5, 2), (4, 6), (1, 3), and (2, 6). 

(iii) Again apply mergesort on above four subarrays resulting 8 sorted 
subarrays of length 1 only 

(5), 2), (4), (6), (1), (3), (2), and (6). 
| aa) AS Apply merging of subarrays to form new sorted array as shown 

in fig. 1.19. 


Sorted Sequence 


vA. nage ra MeN 
Es | 
oN 


\ aa / ‘teraN\ / ters\ 
HOH OH BA @ 


Initial Sequence 
Fig. 1.19 Merging of Sorted Subarrays 
(v) Finally we result with a sorted array 
(1, 2, 2: 33:4; 5; 6:6): 
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0.50. Define and explain mergesort algorithm, (R.GP.V.,, June 2015 
Ans. Refer to Q.45 and Q.49. 

Q.51. Show that the running time of mergesort algorithm On the 


element sequence is O(n log n), even when n is not a power of 2, 
(R.GPV., Dec, 2004 
Ans. If the time for the merging operation is Proportional to n, then 
computing time for mergesort is described by the recurrence relation is 4 
a n=1, a aconstant 
Ua) legate n>I, c aconstant 
We start by assuming that this bound holds for (n/2), that is, that T (nd 
$c (n/2) log (n/2) substituting into the recurrence yields 
T(n) < 2(c (0/2) log (n/2)) + cn 


S en log (n/2) + cn 

= cn logn—cn log2+cn 

= en logn—cn+cn=cn logn 
Thus, T(n) = O(m log n) 


Q.52. What are the limitations of the basic mergesort algorithm ? 

Ans. One complaint, we might raise concerning mergesort is its use 
2n locations. The additional n locations were needed because we could 
reasonably merge two sorted sets in place. But despite the use of this sj 
the algorithm must still work hard and copy the result placed into b[low : hij 
back into a[low : high] on each call of merge. An alternative to this copying. 


to associate a new field of information with each key. This field is used to linl} 


the keys and any associated information together in a sorted list. Then thi 
merging of the sorted lists proceeds by changing the link values, and no reco: 
need be moved at all. A field that contains only a link will generally be small 
than an entire record, so less space will be used. 

Another complaint we could raise about mergesort is the stack space thal 
is necessitated by the use of recursion, Since mergesort splits each set ind 
two approximately equal-sized subsets, the maximum depth of the stack if 
proportional to log n. The need for stack space seems indicated by the top’ 
down manner in which this algorithm was devised. The need for stack space 
can be eliminated if we build an algorithm that works bottom-up. ‘ 


0.53. Write a short note on quicksort. (RGP. V., May 2018) 


Ans. Quicksort, like mergesort, is- based on the divide-and-conquél 
paradigm. Here is the three-steps divide-and-conquer process for sorting 4 
typical subarray A[p,Q............., ba 
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st] is partitioned (rearranged) into 
two nonempty subarrays A[p, +g) and Aq + 1,.. a] 
uch that each element of A[p, q] is less than or equal to each element 
a Alq + Lessee st]. The index q is computed as part of this partitioning 


procedure. 
Conquer — The two subarrays A[p..... 
sorted by recursive calls to quicksort, 
Combine — Since the subarrays the sorted in place, no work is needed to 
combine them. The entire array A[p, 1] is now sorted. 


0.54. Explain how to apply the divide and conquer strategy for sorting 
the elements using quicksort ? (R.GPRV., June 2014, Dec. 2017) 

Ans. The divide-and-conquer approach can be used to arrive atan efficient 
sorting method quicksort. In quicksort, the division into two subarrays is 
made so that the sorted subarrays do not need to be merged later, This is 
accomplished by rearranging the elements in a[1 : n] such that a[i] < a [j] for 
all i between 1 and m and all j between m+ 1 andn for some m,1<m<n. 
Thus, the elements in a [1 : m] and a [m+ 1 : n} can be independently sorted, 
No merge is required. The rearrangement of the elements is accomplished by 
picking some element of a [ ], say t = a [s], and then reordering the other 
elements so that all elements appearing after t are greater than or equal to t. 
This rearranging is known as partitioning. 


t algorithm. Discuss its time complexity. 
Q.55. Write quicksort algorit aie pesi2btt) 


Divide — The array A[p. 


st] are 


4] and A[q + 1, 


Or 
F A an I 
Write the complete algorithm for quicksort. Calculate its time complexity 
in worst, best and average case. (R.GR.V., June 2008, 2009) 


Ans. Refer to Q.53. 

Quicksort algorithm is given as follows — 
Algorithm 1.10 QuickSort Algorithm 
1, Algorithm QuickSort(p, q) ; _— 
2. // Sorts the elements a[p],....., a{q] which reside in Lance 
3. // array af1 : n] into ascending order; a[n + 1) is considered to 
4. // be defined and must be > all the elements in a[1 : n] 
af 
6 if\(p < q) then // If there are more than one element 
its 
8 
9 


MD ide P into two subproblems. 
j == Partition (a, p, q +1); 
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10. //j is the position of the partitioning element, 
ii: // Solve the subproblems. 

12. QuickSort(p, j — 1); 

13. QuickSort (j + 1. q); 

14. // There is no need for combining solutions, 

18. } 

16. } 


Partitioning algorithm is given as follows — 
Algorithm 1.11 Partitioning the Array a[m : p — 1] about a{m] 
1. Algorithm Partition(a, m, p) 
2. // Within a[m], a[m + 1], a[p — 1] the elements are 
3. // rearranged in such a manner that if initially t = a{m], 
4. // then after completion a[q] = t for some q between m 
5. //and p — 1, a{k] <t form <k <q, and a[k] >t 
6. // for q<k <p. q is returned. Set a[p] = «. 


ae 

8. v:=a{m];i = m;j = 
9. repeat 

10. { 

ll. repeat 

12. i=it+l; 

13, until (a[i] 2 v); 
14. repeat 

15, paj—]; 


16. until (a[j] < v); 

17. if (i <j) then Interchange (a, i, j); 
18. }until (i > j); 

19. am] = alj]; a[j] =v; return WE 


Algorithm 1.12 Swapping of Data 
1. Algorithm Interchange (a, i, j) 
2. // Exchange afi] with aj]. 
{ 
p= afi); 
afi] := afj); afi] == p; 
} 


DAwERw 
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Time Complexity of QuickSort Algorithm — 

The running time of QuickSort depends on whether the Partitioning is 
balanced or unbalanced, and this in turn depends on which elements are used 
for partitioning — 

(i) Worst-case Partitioning ~ The worst-case behaviour for 
QuickSort occurs when the partitioning routine produces one region with n — 
1 elements and one with only 1 element, Let us assume that this unbalanced 
partitioning arises at every step of the algorithm. Since partitioning costs O(n) 
time and T(1) = 0(1), the recurrence for the running time is 

T(n) = T(n — 1) + O(n). 
To evaluate this recurrence, we observe that T(1) = 6(1) and then iterate — 
T(n) = T(n — 1) + O(n) 


=> ok) 
k=I 


n 

= (% «| = O(n?) 
k=1 

Fig. 1.20 shows a recursion tree for this worst-case execution of 

| QuickSort. 


@(n?) 


Fig. 1.20 
Thus, if the partitioning is maximally unbalanced at every recursive step 
of the algorithm, the running time is (n?). 


(ii) Best-case Partitioning — If the partitioning procedure produces 
two regions of size n/2, QuickSort runs much faster. The recurrence is then 


i T(n) = 2T(n/2) + O(n) 
which has solution T(n) = 6(n log n). 
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Fig. 1.21 shows the recursion tree for this best-case execution of QuickSoq ‘The total cost of QuickSort is therefore 6(n log n). Thus, with a 9-to-1 
proportional split at every level of recursion, QuickSort in @(n log n) time. In 
fact, even a 99-to-1 split yields an O(n log n) running time. Therefore, the 
"| running time is O(n log n) wherever the split has constant proportionality. 


m1 


0.56. What is the running time of quicksort when all elements of array 
A have the same value ? (R.GPV., Dec. 2008, June 2010) 


a ‘Ans. Ifall elements of the array A have the same value the partition operation 


returns q = aa thus the running time T(n) = 1ff2)}+7((8) + O(n). 


(running time of the Partition operation is @(n)). And we usually omit ceilings 


“@ " | snd floors, hence the recurrence for running time will be T(n) = 213] + O(n). 


©(»/8%) | We remember such form of recurrences and know that T(n) = O(n Ig n) for 
Fig. 1.21 such a recurrence, Let’s prove this bound — 


(iii) Balanced Partitioning — Suppose the partitioning algorit Assume T(n) < c.n.lg n (for n smaller than the given), 
always produces a 9-to-1 proportional split. Then the recurrence relation is 
T(n) = T(9n/10) + T(n/10) + n 

of the running time of QuckSort , where 0(n)is replaced by n for conyenienct| + cn = cn Ig n. 

Fig. 1.22 shows the recursion tree for this recurrence. Not that every level 0.57. What are the advantages and disadvantages of quicksort ? 

the tree has cost n, until a boundary condition is reached at depth log, Ane hd £ Ouicks 

(log n), and then the levels have cost at most n. The recursion terminates ee : vantages of Quic ort . 

depth log, yo = O(log n). ; (i) There is good compromise between number of comparisons and 
lata movements. 


then T(n) <2{o2.1e2]+e0 = cn Ig n—cn + O(n) = cn lgn—cn 


e (ii) This method takes the advantage of initial ordering of the list. 
(iii) Average comparisons are less. 
ww Disadvantages of Quicksort — 


; (i) The behaviour entirely depends upon the selection of pivot (the 
item where the list is partitioned). 

(ii) If pivot is not partitioning the list into approximately equal half, 
the performance degrades sharply. 

(ii) This method uses recursion. Recursion is time consuming. 

(iv) The swaps are definitely greater than selection sort swaps. 


0.58. How many average comparisons are required by the following 
| Sorting algorithms to sort the only k highest elements, out of n elements ? 
Bubble sort, quicksort, insertion sort, mergesort, heapsort. 

(R.GP.V., June 2012) 


Fig. 1.22 
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‘Ans. The table 1.2 presents comparison of various sorting methods, Or 


Table 1.2 Explain Strassen’s matrix multiplication with the help of an example. 
Algorithm Average (R.GPV., June 2017) 
Bubble sort n7/4 A F we . : 
Tasestion sort n/4 Explain Strassen’s matrix multiplication algorithm. 
Quicksort O(n log)n) oes (R.GP.V., Dec. 2017) 

1 
= oe Te a Write short note on Strassen’s matrix multiplication. 
2 


(R.GP.MV, Nov. 2018) 


0.59. Show that the second smallest of n elements can be found Ans. Let A and B be two n * n matrices, The product matrix C = AB is 


n+ [log n] — 2 comparisons in the worst case. (R.GP.V., June 2%) also an n X n matrix whose i, j'* element is formed by taking the elements in 
Ans. Consider, the i” row of A and j column of B and then multiplying them to get 
fh ROP Cae ew CH= Y AGH BD oi) 
— — _— — 
4 2. 5 1 Isksn 
el — 


for all i andj between | and n. 

Now to compute C (i, j) using this formula, we need n multiplications. 
Since the matrix Chas n? elements, the time for the resulting matrix multiplication 
algorithm, which we refer to as the conventional method is @(n?). 

The divide-and-conquer strategy suggests another way to compute the 
product of n * n matrices. 

For simplicity assume that n is an exact power of 2, i.c., there exists a 
non-negative integer k such that n = 2*, In case n is not a power of two, then 
enough rows and columns of zeros can be added to both A and B so that the 
§ resulting dimensions are a power of two. Suppose that A and B are each 
Partitioned into four square submatrices, each submatrix having dimensions 


Thus, we can have the smallest element in n— 1 comparisons. The | 
of comparison whose height is fig n] . We can get the second smallest ele 
in fig n| — 1 comparison. Therefore, total comparisons 

n+ [ign] -2 
Q.60. What is the purpose of Strassen’s matrix multiplication ? 
(R.GP.K, Dec. 
, Ans. The purpose of Strassen’s matrix multiplication is to reduce 
time complexity of matrix multiplication. It uses the concept that addition 
two number is faster than its multiplication. So, the time complexity of Si 


matrix multiplication is O(n25!) which is less than the time complexity’ 


n 
2*>° Then the product AB can be computed by using the above formula for 
ordinary matrix multiplication (O(n). 


the product of 2 x 2 matrices — if AB is 
Fs pa By Bal_ [Cu eal (ii) 
An Ax |B Bol [Ca Cx 
Ci = An By +A12Bai 
C2 = An Biz +Ay2Bo2 


C21 = Azi By +A22Ba 
C22 = Ap Biz + Az2Bon 


Explain the Strassen’s multiplication technique. 


(R.GP¥, June 2007, 2008, 2010, 2011, 20) 
. Or 
Write down Strassen’s algorithm for multiplication. 


(R.GRY, Dec. 2006, 20 


Or 
Discus: ‘ it i 
Ss Strassen’s algorithm Sor matrix multiplication with exd' 


(R.GRY, June 20 


Ifn = 2, the formulas (ii) and (iii) are computed using a multiplication 
peration for the elements of A and B. These elements are typically floating 
Point numbers. For n > 2, the elements of C can be computed using matrix 
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multiplication and addition operations applied to matrices of size n/p 7 - ; Unit-1 53 
Since n is a power of 2, these matrix products can be recursively co The resulting recurrence relation for T(n) is 

by the same algorithm using for the nxn case. This algorithm Will cong b n<2 

applying itself to smaller-sized submatrices until n becomes Suitably smal] T(n) = a2 : ae 
2) so that the product is computed directly. 3 an ask 


To compute AB using equation (iii), we need to perform eight Multiplicay here, a and b are constants. 


Solving above complexity, similar to other recurrence relation, we get 


2 k-1 
T(n)= wo FeQ) +t 2) +7 T (1) 


log, n 
7) 82 ina 
< n'(2) +7 1°82 ca constant 


4 7 4 7 
= enle? "Hog 27—tog2* , 10827 = Q(q!0B97) w O(n?!) 


8 noon : 4 
of n/2 x n/2 matrices and four additions of 7 x 7 matrices, Since two! 


1/2 matrices can be added in time cn? for some constant c, the overall com 
time T(n) of the resulting divide-and-conquer algorithm is given by 
recurrence 


4 b n<2 
Tin) = lene n>2 


where b and c are constants. 


This recurrence can be solved as to obtain T(n) = O(n). Hence! 


So, Strassen’s matrix multiplication has complexity O (n2-81), 
improvement over the conventional method has been made. 


Q.62. How can we prove that Strassen’s matrix multiplication is 
Since, matrix multiplications are more expensive than matrix additi##4vantageous over ordinary matrix multiplication? (R.GP.V., May 2019) 
So, we reformulate the equations for Cy, with fewer multiplications and Ans. Refer to Q.61. 


more additions. 
NUMERICAL PROBLEMS 


Prob.6. Solve the recurrence relation — 


Volkar Strassen discovered, a way to compute the C;’s of equation’ 
using only 7 multiplications and 18 additions or subtractions. , 


For this, first seven oS matrices P, Q, R, S, T, U and V, have t T(n) = 3(n/4) oe (R.GPV., June 2013) 
ir 
computed, as given in equation (iv). Solve the following recurrence relation — 
T(n) = 3T(n/4) +n (R.GRV,, Dec. 2017) 
P=(Aj1 +A22) (By + B22) ed ‘Se 


Q= (Az) +A22)Bi} 

R= Aj)(By) — By) 

S=A2 (Boi —Bj;) 
T=(Ay +Aj2)Bo9 
U=(Ag, ~ Aq )(By + By) 
V=(Aj2 — Ax )(Boy + By) 


After this Gy can be computed using equation (v). 


‘Sol. Given the relation is 
T(n) = 3(0/4) +0 
But the recurrence relation should be 
T(n) = 3T(n/4) + 
We iterate is as follows — 
T(n) =n + 37(0/4) 
=n +t 3(0/4 + 3T(0/16)) 
=n + 3(n/4 + 3(n/16) + 3T(n/64)) 
=n + 3(n/4) + 9(n/16) + 27T(n/64) 
here ((n/4)/4) = (n/16) and ((n/16)/4) = (0/64). 


C,,=P+S-T+v 
Ci\,=R+T 
Cy = 


54 Analysis & Design of Algorithm (B.E., 1V-Sem.) 


The i” term in the series is 34(n/4'). The iterations hits n = 1 
(n/4') = | or, equivalently, when i exceeds logyn. By continuing the j 
's point, we discover that the summation contains a decreasing re 


until 
series — 


T(n) <n + 3n/4 + 9n/16 + 270/64 +..... + 31°84" @(q) 


< 


1 (3) +@(n!843) = gn + o(n) = O(n) 
i=0 


Here, we concluded that 3/084" — ,!og4 3 and we have used the fag 
logy3 < 1 to conclude that © (nls 3)= o(n). jo 
Prob.7. Apply binary search to find 123 in a list — 
45, 96, 105, 121, 145, 192, 199, 205, 245, 275, 123, 850, 904 
(R.GPMV., June 2) 
Sol. Given data is not in sorted form and the requirement of binary sel 
is — the data must be sorted. 
So before performing the binary search, first we have to sort the 
(i) Sort the given data using mergesort. 


(a) Divide the array in two subarrays of size n/2 use this 
until we got one element in every single subarray. 


45, 96, 105, 121, 145, 192,199, 205, 245, 275, 123, 850, 
45, 96, 105,121,145, 192,199, 205, 245, 275, 123, 850, 
45,96, 105 »121,145, 192, 199 ,205, 245 , 275,123,850, 90} 


42,26, 105, 121,145, 192, 199,205,245, 275, 123, 850, 2 
(b) Now, use backward approach to merge & sort the dati 
48,96, 105, 121,145, 192,199,205, 245,123, 275,850, 


45, 96, 105,121, 145, 192 , 199, 205, 245, 123, 275, 850, 


45, 96, 105, 121, 145, 192 ,123, 199, 205, 245, 275, 850, 
45, 96, 105, 121, 123, 145, 192, 199, 205, 245, 275, 850, 905 
(ii) Now apply binary search, 
Given data is in array which is sorted in 
45, 96, 105, 121, 123, 145, 192, 199 
(01 1 (2) (3) (4) [5 [6] 


and we have to search — 123 


increasing numerical orde! 
, 205, 245, 275, 850, 905 
(7] [8] (9) oy qn) 12) 
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So first initialize the variable 
BEG = LB=0 
END = UB= 12 
MID = INT((BEG + END)/2) 
= INT((0 + 12)/2) 
= INT) =6 
Now we check if DATA[MID] = ITEM 
DATA[MID]= DATA[6] = 192 
ITEM = 123 
Clearly DATA[MID]# ITEM 
Since,  DATA[MID]> ITEM 
So, updated variable will be 
BEG =LB=0 
END = UB=MID-1=6-1=5 
MID = INT((BEG + END)/2) 
= INT((0 + 5)/2) 
= INT(2.5) =2 
Now, 
DATA [MID]= DATA[2] = 96 


hich is clearly not equal to ITEM 


Clearly DATA [MID] < ITEM 
So, BEG =LB=MID+1=2 +1=3 
END = UB=5 
MID = INT ((BEG + END)/2) 
= INT((3 + 5)/2) 
= INT(4) =4 
Now, DATA[MID]= DATA[4] = 123 
ITEM = 123 
Clearly DATA[MID]= ITEM 


Hence, search successful. ITEM is found at position 4 in the data after 
orting, 


Prob.8. Write the algorithm for binary search. Apply binary search to 


find 122 in a list — 


44, 95, 104, 120, 144, 191, 198, 204, 244, 274, 122, 849, 904. 
(R.GP.V,, Nov. 2018) 


Sol. Refer to Q.42. 
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Given data is not in sorted form and the requirement of binary se 


the data must be sorted. 


So before performing the binary search, first we have to sort the PH 


(i) Sort the given data using mergesort. 
(a) Divide the array in two subarrays of size n/2 use this 

until we got one element in every single subarray. 
44, 95, 104, 120, 144, 191,198, 204, 244, 274, 122, 849, 


0,144, 191,198, 204, 244,274, 122, 849, 
44, 95, 104,120, 


44,95, 104,120, 144, 191 » 198 , 204, 244 , 274, 122,849, 941 
44, 95 104,120,144, 191,198,204, 244,274, 122, 849, 9 


(b) Now, use backward approach to merge & sort the dat) 


44,95, 104,120,144, 191, 198 , 204, 244, 122, 274,849, 
44, 95, 104,120, 144, 191,198, 204, 244,122, 274, 849, 
44, 95, 104, 120, 144, 191,122, 198, 204, 244, 274, 849, 
44, 95, 104, 120, 122, 144, 191, 198, 204, 244, 274, 849, 
(ii) Now apply binary search. 


Given data is in array which is sorted in increasing numerical o1 
44, 95, 104, 120, 122, 144, 191, 198, 204, 244, 274, 849, 9 
(0) (1) (2) (3) [4] [5] (6) [7] [8] [9] [o} [11] £12) 


and we have to search — 122 
So first initialize the variable 
BEG =LB=0 
END = UB= 12 
MID = INT((BEG + END)/2) 
= INT((0 + 12)/2) 
= INT(@) =6 
Now we check if DATA[MID] = ITEM 
DATA[MID]= DATA[6] = 191 
ITEM = 122 
Clearly DATA[MID]¢ ITEM 
Since, DATA[MID]> ITEM 


and 
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So, updated variable will be 
BEG=LB=0 
END = UB=MID-1=6-1=5 
MID = INT((BEG + END)/2) 
= INT((0 + 5)/2) 
= INT(2.5) = 2 
Now, 
DATA [MID]}= DATA[2] = 95 
which is clearly not equal to ITEM 
Clearly DATA [MID] <ITEM 
So, BEG = LB= MID+1=2 +1=3 
END =UB=5 
MID = INT ((BEG + END)/2) 
= INT((3 + 5)/2) 
= INT(4) =4 
DATA[MID]= DATA[4] = 122 
ITEM = 122 
Clearly ~DATA[MID]= ITEM 


Hence, search successful. ITEM is found at position 4 in the data after 
sorting. 


Now, 
and 


Prob.9. Write the procedure of mergesort and sort the given array of 8 
elements step-by-step using mergesort 35, 18, 7, 12, 5, 23, 16, 3 | 
(R.GBP.¥., June 2016) 
Ans. Refer to Q.46. © 


The list A contains 8 elements as follows — 
35, 18, 7, 12, 5, 23, 16,3 
The process of merge sort is illustrated below — 
Pass I — Following lists are obtained — 
18,35 7,12 5,23 3,16 
eee eer ee 
Pass II — Following two sorted sublists are — 
7,12,18,35 3, 5,16, 23 
SSS ee 


Pass III ~ Single sorted list is obtained after merging the two sorted sublists. 
3, 5, 7, 12, 16, 18, 23, 35 
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Prob.10. Discuss the procedure for mergesort. Illustrate how the 
case performance of mergesort is better than the quicksort. Sort the 
array of 8 elements step-by-step using mergesort — 

A=[36, 19, 8, 13, 6, 24, 17, 4] 
Sol. Refer to Q.46, Q.48 and Q.55. 
The list A contains 8 elements as follows — 
36, 19, 8, 13, 6, 24, 17, 4 
The process of merge sort is illustrated below — 
Pass I — Following lists are obtained — 
19, 36, 8, 13, 6, 24, 4,17 
Be ee 
Pass II — Following two sorted sublists are — 
8,13, 19, 36, 4, 6,17, 24 


(R.GPY:, Noy, 


Pass III — Single sorted list is obtained after merging the two sorted sul 
4, 6, 8, 13, 17, 19, 24, 36 


Prob.11. Sort the given list using mergesort — 
70, 80, 40, 50, 60, 12, 35, 95,10 (R.GP.V., Dec. 2008, June 
Or 
Sort the list 70, 80, 40, 50, 60, 12, 35, 95, 10 by using mergesort. 
(R.GRYV., Dec. 
: ‘Sol. The array of 9 elements a [1 : 9] = (70, 80, 40, 50, 60, 12 35, 9 
is given. Algorithm mergesort splits a [ ] into two subarrays a [1 : 5] 
a[6 : 9]. The elements in a [1 : 5] are then split into two subarrays of size 
(a tl :3]) and two (a [4 : 5]). Then the items in a{1 : 3] are split into s 
of size two (a[1: 2]) and one (a[3 :3]). The two values in a [1 : 2] are 
final time into one-element subarrays and now the merging begins. Pictot 
the file can now be viewed as 
(70 | 80 | 40 | 50, 60 | 12, 35, 95, 10) 
Elements a[1] and a[2] are merged to yield (70, 80 | 40 | 50, 60] 12, 
25, 10). Then a[3] is merged with afl ; 2] and (40, 70, 80 | 50,60 | 12s 
95,10) is produced. Next elements a[4] and a[5] are merged. , 
(40, 70, 80 | 50, 60 | 12, 35, 95, 10) 
and then a [1 : 3} anda [4; 5] 
(40, 50, 60, 70, 80 | 12, 35, 95, 10) 
Now, the mergesort i 
recursive calls rvdcar vend a aie os 


(40, 50, 60, 70, 80 | 12, 35 | 95, 10) 


then a [6:7 


upon 


numbers; 
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Elements a[6] and a]7] are merged. Next a[8] and a[9] are merged, and 
] and a [8: 9] 
(40, 50, 60, 70, 80 | 10, 12, 35, 95) 


(10, 12, 35, 40, 50, 60, 70, 80, 95). 


Prob.12. Sort the following list using quicksort technique and argue 
its running time 
A=[5, 7, 9 4 10, 2, 8, H 
Sol. The given list of elements A is as follows — 
5,7, 9, 4, 10, 2, 8, 1 
The reduction step of quicksort algorithm finds the final position of the 
procedure steps are as follows — 


(R.GPV, Dec. 2015) 


© 7 9 4 0 2 8 ® 

@7z 9 40 28 © 
1 @® 9 40 28 @ 

1@ 9 4 0 © 8 7 
1 2 @® 4 0 @ 8 we 
1 2 @ ® 0 9 8 7 


Number 5 is placed in its final position. We have two sublists, one left of 


5 and second right of 5. 


12 4@10 9 8 7 
First Sublist Second Sublist 


nal list has been reduced to the task of 
ublist is already sorted. Applying 
d sublist, results in a completely 


Now the task of sorting the origi 
sorting each of the above sublists. The first s 
same quicksort algorithm recursively to secon 
sorted list i.e. 

1, 2, 4, 5, 75 8 9,10 


‘ksort — 


Prob.13. Sort the following list using quicl (R.GPY,, June 2017) 


36, 95, 42, 12, 08, 66, 72, 55 
Sol. Suppose A is the following list— 


@, 95, 42, 12, 08, 66, 72, @) 
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Scan the list from right to left, comparing each number with 36 
where the element is less than 36. The number is 8. Interchange 36 and 
obtain the list. 


@, 95. 42, 12, 9, 66, 72, 55 


Beginning with 08, scan left to right and stop where the element is 
than 36. The number is 95. Interchange 36 and 95 to obtain the list, 


Cie 
08, G6), 42, 12, @5), 66, 72, 55 
ae 


Now, applying the same procedure while 36 not placed in correct 
we get two sublists. 


08, (12), 42, G6), 95, 66, 72, 55 
@.2.89 


08, 12, G8), 42, 95, 66, 72, 55 
Now do quick sort parallely in each sublist. 
08, 12, 36, @), 95, 66, 72, 55 
08, 12, 36, 42, 95, 66, 72, 55 
Se? cet Se Ga? cone eee 


08, 12, 36, 42, 


08, 12, 36, 42, 55, 66, 72, 
08, 12, 36, 42, @), 66,72, 95 


08, 12, 36, 42, 55,@, 72, 95 
08, 12, 36, 42, 55, 665.72, 95 
QB) 12» 28> 22, 29, 88 2, 3 
Sorted List — 8, 12, 36, 42, 55, 66, 72, 95 


Prob.14. Apply quicksort to sort the following list — 
36, 12, 85, 79, 46, 18, 92, 30, 28, 65,72 (R.GPV., May 
Sol. Suppose A is the following list — 


G6), 12, 85, 79, 46, 18, 92, 30, 28, 65, @ 


Scan the list from right to left, comparing each number with 36 ant 


where the element is less than 36. The number is 28. Interchange 36 an” 
obtain the list. j 


@), 12, 85, 79, 46, 18, 92, 30, G6), 65, 72 
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Beginning with 28, scan left to right and stop where element is greate: 
than 36. The number is 85. Interchange 36 and 85 to obtain the list. wis 


28, 12, 79, 46, 18, 92, 30, ®) 65,72 
Now beginning with 85, scan the list right to left, comparing each number 
with 36 and stop where the element is less than 36. The number is 30. 
Interchange 36 and 30 to be obtain the list. 


28, 12, (30) » 79, 46, 18, 92, 6), 85, 65, 72 


Now beginning with 30, scan left to right and stop where the element is 
greater than 36. The number is 79. Interchange 36 and 79 to obtain the list. 


28, 12, 30, Ge), 46, 18, 92, 79, 85, 65, @ 


Now, applying the same procedure while 36 not placed in correct position, 
we get two sublists. 


28, 12, 30,36), 46, 18, 92, 79, 85, 65,(72) 
< less than 36 


, 

28, 12, 30, (18), 46, (36), 92, 79, 85, 65, 72 
any 

28, 12, 30, 18,66), (48), 92, 79, 85, 65, 72 


— greater than 36 
Now 36 is at its final position, and the list is divided in two sublists. 


28, 12, 30, 18, (36), 46, 92, 79, 85, 65, 72 
I I 
Now, we sort the above first sublist repeating the same procedure. 


8), 12, 30,(18) 


< less than 28 


[Interchange 28 and 18] 
8), 12, 30,8) 


— greater than 28 


18,12, @). 
XO 328,30 [Interchange 18 and 12] 


Now 28 is at its proper place and sorted sublist is 
12, 18, 28, 30 


[Interchange 28 and 30] 
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Now we sort the second sublist repeating the same procedure, 


@), 79.85, 65,(2) 


— less than 92 


@),79.85.@), 2 


— greater than 65 


so“ 
CHORD ORS 


6. 2.O.0.2 


65, 72, 79, 85, 92 
And sorted sublist is 
65, 72, 79, 85, 92 
Hence, the original, sorted list will be 
12, 18, 28, 30, 36, 46, 65, 72, 79, 85, 92 
Prob.15. Apply quicksort algorithm for the following array and sor 
element (Take first element of the list as the pivot element). 


24, 56, 47, 35, 10, 90, 82, 31. 
Also discuss complexity of algorithm. (R.GRV, Dec. 


Sol. Pivot = 24. 
Scan the list from right to left, comparing each number with pivot 
24, and stop where the element is less than 24. The number is 10, Interchi 
24 and 10. Now the list will be 


©, 56, 47, 35, @, 90, 82, 31 
Beginning with 10, scan left to right and stop where the element is 
than 24. The number is 56. 
Interchange 56 and 24 to obtain the list. 
10, @), 47, 35, 56, 90, 82, 31 
Now, 24 is placed at its correct position, 
So, the list is divided into two sublists, 
10,@, 47, 35, 56, 90, 82, 31 
Sublist Sublist 
Apply, same procedure on two sublists concurrently. 


Pivot 


ee, 
10, 24, QBs, 6, 90,82 @ 
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, 35, 56, 90, 82, 
10,4. @ @ 
porter 
ite a 
1, 35, 66), 90, 82, 
10, 24, 3 90, 82, 
10, 24; 31, 35-@, 90.82.56 
10, 24.31 35. OL 2B 
Ans. 


10, 24, 31, 35, 47, 56, 82, 90 
Complexity of Quicksort — Refer to Q.55. 


5 “Seo 2 3 A 4 i 

4 3 2 6 afte 
Prob.16.If A=\7 3 7 4? 7=13 9 0 3 
9 4 6 7 7 62°51 
and B. 


4 Strassen’s matrix multiplication on A 
my (R.GR.V. Dec. 2008) 


Sol. Given two matrices of 4 x 4 and hence its product will be 4 * 4. 


‘Therefore n = 4 = 2”. ; 
Now these two matrices are partitioned into four square submatrices, 


each submatrix having dimensions 2 * 2. 
Thus, the product A x B = C can be calculated as follows — 


AE PE 
s][sal! Pei 
“CIEIGRE 
eaten 
“(2 0 DG I-18 WEA 


R=Ay (By - By) 
4 4] _ [20 ] 
= (3 Al | i (76 40 


“2310 3-B i) 
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S = Ag (Ba — Buy) 


[-1 -2][3 12] 
[-4 -1}]9 7} 
=P+S-T+V 
[46 72 


Cy 


Cy=R4+T= fe mal 


1 
16 40)"|1 


67 85 
Cy=P+R-Q+U 


8 
CG,=0+s=/48 76], [20 
2 Q+8=| +135 


-[46 72],[20 44 
70 110|*}16 40|~ 


Hence, the product C is 


35 37] [30 64 
_ [8 7 Es 67 


68 87] [52 128 
[% Al Es 124 
35 37 30 64 
66 77 34 67 


68 87 52 128 
102 134 58 124 


or 


20 11 
[70 rro}*[38 i 


[ 


0 


[ 


10 20 
18 27 


20 
27 


11 
49 


48 76 
67 85 


+ 


[ 


21 -26] _ 
-21 -55 


30 64 
34 67 


68 87 
102 134 


34 88 
}+[33 39] 


| 


35° 37; 
66 77. 


52 128 
58 124 


STUDY OF GREEDY STRATEGY, EXAMPLES OF GREEDY 
METHOD LIKE OPTIMAL MERGE PATTERNS, HUFFMAN 
CODING, MINIMUM SPANNING TREES, KNAPSACK _ 
PROBLEM, JOB SEQUENCING WITH DEADLINES, SINGLE _ 
SOURCE SHORTEST PATH ALGORITHM ; 


0.1. Explain about greedy technique. 
Or 
Explain the concept behind greedy strategy. 
Or 


(R.GPV., June 2015) 


(R.GP.V, Dec. 2015) 


(R.GP.V., June 2016) 


Ans. The greedy method says that one can devise an algorithm that 
orks in stages considering one input at a time. A decision is made regarding 
hether a particular input is in an optimal solution at each step. This done by 
onsidering the inputs in an order determined by some selection procedure. If 

he inclusion of the next input into the partially constructed optimal solution 
ill result in an infeasible solution, then this input is not added to the partial 
Solution. Otherwise, it is added. The selection procedure itself depends on 
pome optimization measure. This measure may be the objective function. In 
fact, several different ‘optimization measures may be possible for a given 
problem, However, most of these will result in algorithms that generate suboptimal 
Solutions. This version of greedy technique is known as the subset paradigm. 


What is greedy approach ? 


2.2. What is an optimal solution ? 
Or 


What do you mean by feasible solution ? (R.GP.V, Dec. 2014) 


Ans. Most of the problems have n inputs and require us to obtain a subset 

hat satisfies some constraints. Any subset that satisfies these constraints is 

‘alled a feasible solution. We need to get a feasible solution that either maximizes 

Or minimizes a given objective function. A feasible solution that does this is 
alled an optimal solution. 
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0.3. What is greedy techniques ? Derive the equation for the Unit- Il 67 
solutions. (R.GPRY, Deg, tye problem we address ourselves is that of finding an optimal way (one requiring 

Ans. Refer to Q.1. he fewest campersone) vata merge n sorted files. As this problem calls 

Equation for Optimal Solution — If A is the set of all feasible fo" 7 ordering among the pairs to be merged, it fits the ordering paradigm. 
0.6. Write and explain the greedy strategy for optimal merge patterns. 


of any problem f( ). Then the optimal solution will be — 
max(f(a)) or min(f(a)) or 
where a € A How two way merge pattern can be represented by binary merge tree ? 


ae > GPK. 
0.4. Write the general characteristics of greedy algorithm, (R.GP.V., June 2016) 
(R.GPM, June 2014, Deg, 


Ans. Some of the general properties of greedy methods are — 


(i) Greedy-choice Property — The first key ingredient is the 
choice property. A globally optimal solution can be arrived at by m 
locally optimal (greedy) choice. Here is where greedy algorithms diffe 
dynamic programming. In dynamic programming we make a choice 
step, but the choice may depend on the solutions to subproblems. Inag 
algorithm, we make whatever choice seems best at the moment 
solve the subproblems arising after the choice is made. The choice ma 
greedy algorithm may depend on choices so far, but it cannot depend 
future choices or on the solutions to subproblems. Thus, unlike 
programming, which solves the subproblems bottom up, a greedy s4 
usually progresses in a top-down fashion, making one greedy choict 
another, iteratively reducing each given problem instance to a smaller 


Or 
Explain the concept behind greedy strategy. Using optimal merge pattern 
breedy method, merge the following files, fy, fy fy fy and fs with 20, 30, 
70, 5 and 30 number of elements respectively. (R.GP.M, Nov. 2018) 
Ans. According to greedy method, since merging m-records file and 
-recards file requires possible m + n record moves, the obvious choice for a 
election criterion is — at each step merge two smallest size files together. 
Thus if we have five files (x, Xz, ....5 X5) with sizes (20, 30, 10, 5, 30), our 
reedy rule would generate the following merge patterns — 
(i) Merge two files, i.e., x, and x4 with record length 10 and 5 
spectively, resulting in a file z, (|z,| = 15). 
ii) Merge z, with x, (|x,| = 20) to result a file z, (|Z = 35). 
(iii) Now, merge files x3 and x, to get 23 ([23] = 60). 
(iv) Finally merge z, and z, resulting file z, with 95 record movements. 
25 e : . The above method results in total 205 record movements. Above merging 
, (ii) Optimal Substructure — A problem exhibits optimal subs be shown in fig. 2.1 
if an optimal solution to the problem contains within it optimal sol ae oe 
‘ : : . 3 In the fig. 2.1, we have five external nodes indicating five files, represented 
subproblems. This pro cab ig. 2.1, We la é 
dynamic rograunaalie sa a ice nw the appli by rectangle. All other files are indicated by internal nodes in the form of 
7 Steedy algercnas ircles. Each internal node has exactly two children. The external node x, is at 
Q.5. Explain the optimal merge pattern briefly. distance of 3 from the root z4 (a node 
(R.GRYV., June 20087 level i is at a distance of i - 1 from 
Ans. Optimal merge pattern is a pattern that relates the merging € root). Hence, the records of file x4 
or more sorted files in a single sorted file, [re moved three times, once to get 2), 
If we have two sorted files containin iveljpnce again to get z, and finally one 
ig n and m records respect! : % 
be merged together, to obtain one sorted file in time O (n + m). more time to get z,. 
For example, if files x. J If d; is the distance from the root to 
? > 1s X2, X3 and x4 are to be merged, we © i ice from the 
merge X; and x to geta file yj. Then y, and x3 are i to get yl} © “xtemal node for filex;, and q;thelength 
¥2 and xq are merged to get the desired sorted file. Alternatively, we pfx; then the total number of record 
merge x; and x2 getting y; and then x3 and x4 to get Finally. yi agg 5 for Chis binary merge tree is — 
merged to get the desired sorted file. i Saas n sr arinsosiaereaill 
There ai Vays ji A oo d; qj Fig. 2.1 Binary Merge Tree 
sorted file, Different ae pairwise merge can be done to gett x ad Representing a Merge Pattern 
. pairings require different amounts of computing ™ 


i=l 
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This sum is called the weighted external path length of the treal 


imal two-way merge pattern corresponds to a binary 1m, 

veal ais weighted external path length. The function tree of g 
2.1 uses the greedy rule to get a two-way merge tree for n files. The aj 
contains as input alist list of n trees. There are three fields, Ichild, roby 
weight in each node in a tree. Initially, each tree in list contains just ong 
This external node has /child and rchild fields zero whereas weight; 
length of one of the n files to be merged. For any tree in list with root 
t > weight gives the length of the merged file it represents. There ay 
functions least (list) and insert (list, t) in function tree. least (list) obtain 
in list whose root has least weight and returns a pointer to this tree, Th 
is deleted from list. Function insert (list, t) inserts the tree with root ti 

The main for loop in this algorithm is executed n — | times. If listiy 
in increasing order according to the weight value in the roots, then leas, 
needs only O (1) time and insert (list, t) can be performed in O (n) 
Hence, the total time taken is O (n2). If the /ist is represented as a mit 
which the root value is less than or equal to the values of its children, 
least (list) and insert (list, t) can be done in O (log n) time. In this situati 
computing time for tree is O (n log n). 

Algorithm 2.1 Algorithm to Generate a Two-way Merge Tree | 


treenode = record { 
treenode * /child; treenode * rchild; 
integer weight; 


} 
Algorithm Tree(n) 
// list is a global list of n single node 
// binary trees as described above. 
{ 
for i:= 1 ton—1do 
i 
pt = new treenode; // Get a new tree node. 
(pt + child) := Least(list); // Merge two trees with 
(pt > rchild) := Least(list); // smallest lengths. 
(pt > weight) := (pt > Ichild) — weight) 
_ (Pt re tld) + weight); 
insert(list, pt); 
1 
} 


return least(/ist); 


1 
2. 
3 
4 
5. 
6 
i 
8. 
9. 
10. 
IL 
12. 
13 
C // Tree left in list is the merge tree. 


3 
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Q.7. Discuss in brief Huffman codes. 
Ans, Binary trees with minimal weighted external path length can be used 
optimal set of codes for messages Ly oe M,41- Each code is a 
that is used for transmission of the corresponding message. At 
the receiving end the code is decoded using a decode tree. A decode tree is a 
binary tree in which external node represents Messages. The binary bits in the 
code word for a message determine the branching needed at each level of the 
decode tree to reach the correct external node. For example, if we interpret a 
zero as a left branch and a one as a right branch, then the decode tree of fig. 
responds to codes 000, 001, 01 and 1 for messages M,, M,, M; and 
My respectively. These codes are known as Huffman codes. The cost of 
decoding a code word is proportional to the number of bits in the code. This 
number is equal to the distance of the corresponding external node from the 
root node. If q; is the relative frequency with which 
message M, will be transmitted, then the expected 
decode time is Dy <j < +1 %4j where d; is the 
distance of the external node for message M, from 
the root node. The expected decode time is 
minimized by choosing code words resulting in a 
decode tree with minimal weighted external path 
length. ©, <; <~ +1 4id) is also the expected length 
of a transmitted message. Hence the code that 
minimizes expected decode time also minimizes the 
expected length of a message. 


Q.8. Define the external path length. (R.GPV., June 2015) 
Ans. The external path length is the sum of the lengths of all the paths from 
the root to any external node. The length of the path is the number of its edges. 

Q.9. Explain greedy algorithm for constructing a Huffman code. 

(R.GP.V., June 2010) 

Ans. An optimal prefix code referred to as a Huffman code is constructed 
by a greedy algorithm invented by Huffman. The tree T corresponding to the 
Sptimal code is built by the algorithm in a bottom-up fashion. The algorithm 
starts with a set of |C| leaves. It performs a sequence of |C| — 1 merging 
©Perations to obtain the final tree. 

Th the pseudocode, it is assumed that C is a set of n characters in which 
Pe Character CeC is an object with a defined frequency fC]. The two 
Sast-frequency objects to merge together are identified using a priority queue 
tl es oe on f. This results in a new object whose frequency is the sum of 

Tequencies of the two objects merged. 


to obtain an 
binary string 


2.2 col 


Fig. 2.2 Huffman Codes 
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For example, the working of Huffman’s algorithm is as shown in fig. 2.3. 


HUFFMAN (C) loti’ 

@) ae Ic| The initial queue size n is 6 because there are 6 letters in the alphabet. The five 

(i) PQe Ic| merge steps are needed to build the tree. The optimal prefix code is shown in 

(ii) forj<- 1 ton— 1 the final tree. For a letter, the sequence of edge labels on the path from the root 
LLOCATE-NODE( ) to the letter is the codeword. 


(iv) doz<A 
(vy) x left[z] <— 
wi) ye right(z] <— E 
(vii) fz] < fx] + fy] 
(viii) INSERT(PQ, Z) 

(ix) return EXTRACT-MIN(PQ) 


ee 2) 


EXTRACT-MIN(PQ) 


XTRACT-MIN(PQ) ‘The initialization of the priority queue PQ with the characters in C is done by 


give (ii). In lines (iii) — (viii), the for loop repeatedly accesses the two nodes x and 
y of lowest frequency from the queue, and replaces them in the queue with a new 
node z. Line 7 calculates the frequency of z as the sum of frequencies of x and y. 
The left and right children of the node z are x and y, respectively. Line (ix) returns 
the one node left in the queue that is, the root of the code tree, after n— 1 mergers. 
It is assumed that PQ is implemented as a binary heap for the analysis of 
the running time of Huffman’s algorithm. The initialization of PQ in line (ii) is 
done in O(n) time for a set C of n characters, In line (iii) — (viii), the for loop 
is executed exactly |n|— 1 times. The loop contributes O(n Ig n) to the running 
time, because each heap operation needs time O(lg n). Therefore, the total 
running time of HUFFMAN (C) on a set of n characters is O(n Ig n). 


0.10. What is minimum spanning tree ? (R.GP.V., Dec. 2014) 
Or 

Define minimum spanning tree. (R.GRV, June 2015) 
Or 


Write short note on minimum spanning tree. (R.GP.V., Dec. 2017) 

Ans. A spanning tree of a graph G is a minimal subgraph connecting all 
he vertices of G. If graph “G” is weighted graph then the weight or cost of a 
spanning tree “T” obtained from a graph “G” is defined as the total sum of all 
© weights associated with the branches in the given spanning tree “T”. As 
‘¢ have observed that there exists several spanning trees of a graph “G” so in 
the case of weighted graph, different spanning trees of “G” will have different 
eights. A spanning tree with the minimum weight in a weighted graph is 
alled minimal spanning tree or shortest spanning tree or minimum cost 
spanning tree. 
Q.11. What do you mean by minimum spanning tree problem ? Explain. 
Ans. A spanning tree for a connected, undirected graph, G = (V, E), is a 
subgraph of G that is an undirected tree and contains all the vertices of G. In 
A Weighted graph G = (V, E, W), the weight of a subgraph is the sum of the 
p eights of the edges in the subgraph. A minimum spanning tree (MST) for a 
J*eighted graph is a spanning tree with minimum weight. 
There are-two algorithms for solving minimum — spanning tree problem. 

(i) Prim’s algorithm and (ii) Kruskal algorithm. 
Both the algorithms are Greedy approach to the problem. 


(@- 7) 
Fig. 2.3 The Steps in Huffman’s Algorithm .. 
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minimize the cost of the tree or maximize the 
rithm grows a spanning tree by adi 
ample of connected graph and its 
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Ateach step we try to 
Minimum spanning tree algo! 

edge ata time. Fig. 2.4 shows an ex: 

spanning tree. 


Fig. 2.4 A minimum spanning tree for a connected graph, 
weights on edges are shown, and the edges in a minimum spanning 

are shaded. The total weight of the tree shown is 37. The tree is 
unique: removing the edge (b, c) and replacing it with the edge (a, h) 
another spanning tree with weight 37 


0.12. Write Prim’s algorithm to get minimum cost spanning trai 
give its complexity. 


Or 
Explain Prim’s algorithm. (R.GPMV, June 
Or 7 
Give an algorithm for computing minimum spanning tree. 


(R.GRY., “| 
Ans, Prim’s algorithm is a special case of generic minimum-s} 
tree algorithm. 
Prim’s algorithm is given in algorithm 2.2. 
Algorithm 2.2 Prim’s Mii 
Algorithm Prim(E, cost, n, t) 
// B is the set of edges in G. cost{1 : n, 1 : nJ is the cost 
// adjacency matrix of an n vertex graph such that cost fi, 8 
// either a positive real number or if no edge (i, j) exists. 


imum-cost Spanning Tree Algoritho) 


1 

2. 

3 

4 

5. // Aminimum spanning tree is computed and stored as a set af 
6. // edges in the array t{1 : n—1, 1 : 2]. (t{i, 1], tfi, 2]) is a" oil 
: // the minimum-cost spanning tree. The final cost is returne™ 
9. Let (k, J) be an edge of minimum cost in E; 

10. mincost := cost [k, J]; ees ij 
{hd =ki2y=2 : | 


12. for i= 1 ton do // Initialize near. 
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13. if(cost[i, /] < cost[i,k]) then nearfi] := 
14. else near[i] = 
15. near[k] := near [/] = 
16. for i:=2ton—1 do 
17. { // Find n — 2 additional edges for t. 
18. Let j be an index such that near[j] # 0 and 
19. cost[j, near[j]] is minimum; 
20. ¢{i,1] -is ti,2] = nearfj}; 
21. mincost := mincost + cost[j, near[j]]; 
22. near[j] = 0; 
23. for k = 1 to n do // Update near{). 
24. if ((near [k] # 0) and (cost[k, near[k]] > cost{k, j])) 
25. then near[k] == j; 
26. } 
21: return mincost; 
28. } 


In above algorithm we have E i.e., the set of edges in G. 

cost [1: n, 1 : n] is the cost adjacency matrix of an n vertex graph such 
that cost [i, j] is either a positive real number or if no edge (i, j) exists. 

‘A minimum spanning tree is computed and stored as a set of edges in the 
array t{1 : n— 1, 1: 2]. (ti, 1, tli, 2) is an edge in the minimum-cost 
spanning tree. The final cost is returned. 

Prim’s algorithm has the property that the edges in the set A always form 
asingle tree. The tree starts from an arbitrary root vertex r and grows until the 
tree spans all the vertices in V. At each step, a light edge connecting a vertex in 
A toa vertex in V —A is added to the tree. The next edge chosen according to 
minimize the cost of the tree i.e., an edge that results in a minimum increase 
of the sum of costs of the edges so far included. The Prim’s algorithm will 
start with a tree that includes only a minimum-cost edge of G. 

Then the edges are added to the tree one by one. 

The'next edge (i, j) to be added in. such that iis a vertex already included in the 
tree. jis a vertex not yet included, and cost of (,j), cost, jis minimum among call 
edges (kc, 1) such that vertex K is in the tree and vertex / is notin the ree 

: For this we make a check for every pos we 
Still not in tree, with a node present in tree for their minimum cost. For f 
determining this new edge (i, j) efficiently, we associate with each vertex j not q 
yet included in the tree a value near{j]. The value near| {j] is a vertex in the tree 
such that cost[j, near{j]] is minimum among all choices for near{j] we defind 


sible edge that connects @ node 
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ear[j] = 0 for all vertices j that are already in the tree. The next edge tg: 
near{j]= 


is defined by the vertex j such that near[j] + 0 ( j not already in the tea} 
cost [j, near[ j]] is minimum. - 
Complexity — The time required by Prim s algorithm is O(n2), vy 
is the number of vertices in the graph G. Notice that line 9 lakes O(1B}) 
and line 10 takes @(1) time. The for loop of line 12 takes O(n) time, Ren, 
18, 19 and the for loop of line 23 need O(n) time. So, each iteration of; 


loop of line 16 takes O(n) time. ‘The total time for the for loop of line 16ig 
O(n2). Thus, Prim runs in O(n?) time. 

0.13. Write the Kruskal’s algorithm for obtaining minimum Spa 
tree. Calculate its time in worst case. (R.GPMK., Dec, P| 

Or 

Define Kruskal’s algorithm. Also write down the steps for Ki 

algorithm in detail. (R.GRYV., June 
Or 

Given E is the set of edges in graph G G has n vertices. Cost lu, Ks | 
cost of edge (u, v). T is the set of edges in the minimum-cost spanning 
Write the pseudocode for Kruskal algorithm by considering para 
mentioned above. (R.GPYV, June 

Ans. Let A be a subset of E that is included in some minimum s] 
tree for G. In Kruskal’s algorithm, the set A is a forest, The safe edge ad 
A is always a least-weight edge in the graph that connects two 
components. While in Prim’s algorithm, as we studied earlier, the set A fo 
a single tree. The safe edge added to A is always a least weight edge conn 

e tree to a vertex not in the tree. Kruskal’s algorithm is given in algorithm 
Algorithm 2.3 Kruskal Algorithm 

Algorithm Kruskal (E, cost, n, t) 
//E is the set of edges in G. G hi 
// cost of edge (u, 
// spanning tree. 


‘as N. vertices. cost[u, v] is the 
V). tis the set of edges in the minimum-cost 
The final cost is returned. i 


Construct 4 heap out of the edge costs using Heapify; 
for i:=1tondo Parent[i] :=— 1; 

// Each vertex is in a di 
i= 0; mincost := 0.0; 


= (Gi<n~1) ana (heap not empty)) do 


ifferent set. 


SS ee we asesaw & w _ 
SHES PPA AV Seb» 


Delete a minimum cost 
x edge (u, v) from the heap 
and reheapify using Adjust; 
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4 j == Find(u); k = Find(y); 
fa if ( # k) then 

: { 
a iit; 
18. t[i,1] =u; t[i, 2] = v; 
9. mincost := mincost + cost[u,v]; 
20. Union(j, k); 
21. } 
22. q : oe 
23. if (i #n — 1) then write (“No spanning tree”); 
24, else return mincost; 
25. } 


In Kruskal algorithm, at each step, we have to find the minimum cost 
edge in given graph so as to minimize the cost of the tree. 
In Kruskal method, if initially E is the set of edges in graph G. 
Then, the two main functions that we wish to perform are — 
(i) Determine an edge with minimum cost. 
(ii) Delete this edge. ; , 
Both of above functions can be performed efficiently if the edges in the E 
are maintained as a sorted sequential list. For this, edges are maintained as 
minheap, then the next edge to be considered can be obtained in O(log |E|) 


isiy_ time. While the construction of heap itself takes (|E|) time. 


Secondly, after determining the next minimum cost edge, we have to make 
sure that this edge is not going to result in a cycle. If it is resulting acycle then 
it will be discarded and new edge will be searched, otherwise it will be added. 

For determining this we prepare two sets. One set has all connected 
components of t. Then, two vertices u and v are connected iff they are in the same 
set. And the other set have all the components that are not connected to tree t. ; 

On the basis of above two sets, all the edges that connect vertices present in 
same set are discarded, as they result into a cycle. And the edge that connects ba 
Vertices in the different set is included in the tree. As it does not result into acycl S 

The computing time is, therefore, ae by the time for lines 4 an 
5, which in the worst case is O ({E| log |E)). ren 

Based on above discussion in algorithm 2.3, we first construct a initial 
heap of edges i as given in line 6. — 
¥ ey, aa —- is assigned to a distinct set (and hence a anne 
tree), The set t is the set of edges to be included in the minimum-cost re 8 
tree and i is the number of edges in t. The set t can be spe ie 
Sequential list using a two-dimensional array t[1: n- 4 te 2]. Edge (u, 
be added to t by the assignments t[i, 1] = u; and t[i, 2)=Vv. 
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i ine 10, edges are removed from the heap on, Unit- I 77 
ee i 7 determines the sets containing We mene that hs Rion or bag lias capacity en 
jk, then vertices u and v are in different sets (and so in different consider that if a fraction a < Xj < 1 of object iis placed into the Kaapracie 
edge (u, v) is included into t. The sets containing u and vare combined (lng}then the profit p; sa a earned, 

If u=y,, the edge (u, v) is discarded as its inclusion into t would Create g The objective is to fill the Knapsack 50 as to maximize 
Line 23 determines whether a spanning tree was found. It folloy,/earned. With a constraint that the total weight of all the obje 

i#n—1 iffthe graph G is not connected. The computing time is O(IE| log should be at most m. 

where E is the edge set of G. 


the total profit 
ct in Knapsack 


blem can be stated as — Maximize 5X wai 

Q.14. Whatis spanning tree ? Write Kruskals algorithm with an Thepe " mi xj (i) 

to find minimal spanning tree. (R.GRY, June Subject to Vw <m wufii) 
Ans, Refer to Q.10, Q.13 and Prob.12. Isisn . 

0.15. Tabulate the differences between Kruskal’s and Prim’s algorq and 0<x; <1,and1sisn sen iii) 

(R.GPL, Den Here, the profits and weights are positive numbers. 
5 Or i eee ae 
. — . 5 Any Set (Xj yess .X,) is said to be feasible if it satisfies equation (ii), and 
er ihe basteldig erence’ betwee LASS worn ool said toyb@'@ptémsal ifffor which equation (j) is maximized. Algorithm of greedy 
algorithm. GPK, Dec, 


Knapsack is given in algorithm 2.4, 

Algorithm 2.4 Algorithm for Greedy Strategies for the Knapsack Problem 
Algorithm GreedyKnapsack(m,n) 

// p{1 : n) and w [1 : n) contain the profits and weights respectively 
// of the n objects ordered such that p[iJ/w[i] = p[i + 1)/w[i+ 1] 

// m is the Knapsack size and x{1 : n] is the solution vector. 


Ans. The difference between Kruskal’s and Prim’s algorithm areas folly 
Kruskal’s Algorithm 


It uses global approach i.e., at 
every step, it chooses the 
cheapest available edge anywhere 


Prim’s Algorithm 


It uses local approach ice,, atex 
step, it chooses the cheapes | 
available edge attached to any 


we eranwswne 


which does not violate the goals previously chosen vertex whi { 

of creating a spanning tree, does not violate the goals of for i := 1 ton do x{i] = 0.0; // Initialize x. 
creating a spanning tree. Us=m; 

It begins with an edge. It starts with a node. for i:=1tondo 

It selects the next edge in hapha- | Itmoves fromi one node to andl { be 

zard way but in increasing order, f 10. if (w[i] > U) then break; 

At any point of time, the set of |'At any point of time, these) =), x{i] := 1.0; U = U-whil; 

selected edges need not belong | selected edges will form a5" 12, } i 

to the same tree, It forms forest. | tree. 13. if (<n) then x{i] = Util; 

Time complexity O(log V) ‘Time complexity = O(V”) 14. } _ es 


where V = number of vertices 
Works on both connected or 
disconnected graph. 


9.16. What is Kn 


0.17. What is Knapsack problem in greedy strategy ? Write the running 


. 018) 
time and recurrence relation of Knapsack algorithm. (R.GRY.,, May 2018) 


Ans. Knapsack Problem — Refer to Q.16. 


It is restricted to work.on com 
graphs. 


ing ; the HE. 
‘apsack problem ? How can we solve using & The running time of Knapsack algorithm can be considered Bt 
approach? (R.GPVs, May There are nisin ( ivially bounded by O (n‘)) executions ofall possible 
Ans, In Knapsack problem we are given objects, also weight Mainly the ") (trivially 


object is given, i.e., object i has weight w. 
ie 
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subsets of cardinality / to pet 
(n!*}) time bound. The gree! 
for sorting the items. 

It will be desirable to have € approximation schemes where the 
time raises only moderately both with the accuracy and with the Dun 
items. Thus, the ¢ approximation schemes can be classified on the fin 
of € on their running tim 
be given as — 

Consider n objects, where object i has weight wi and value yj 
positive), and a Knapsack with a weight capacity W. 


Now, select some of the objects to fill the Knapsack so as to maxi 


the total value, without violating the weight constraint. 


There are two possible greedy heuristics fails for the 0/1 Knap greedy approach, 


problem — 
(i) Maximize value without regard for weight — 
Pack most valuable objects first. 
(ii) Maximize value per unit weight — 
Pack objects in decreasing order of value/weight ratio. 


0.18. Explain the greedy strategy. Write algorithm for Knapsack p 


(R.GP.V., Dec. 2007, 2009, 
Or 


Explain the greedy strategy. Write algorith 

Knapsack problem. iil a * G. ee 
Ans. Greedy Strategy — Refer to Q.1. 7 
Knapsack Problem — Refer to Q.16. 


(R.GP.V., June 


Ans. Say that the gree 

: greedy Strategy uses ‘ a 
and the rest is part of the i + Ist most the i most expensive items 
non-greedy me 


the missing 
You can Tepeat th 
greedy mix but inc! 


Sreedy solution; and your greedy mix is at 


form. Since the running time linearly Yields 
dy strategy requires an additional O (n log : 


e. The recurrence relation of Knapsack algoritha| 


" 
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Discuss job sequencing problem by an example. 
: 7 (R.GP.V., June 2016) 

Ans. There is a set of n jobs. Associated with job i is an integer deadline 
g,20anda profit p; > 0. For any job i the profit p; is earned iff the job is 
completed by its deadline. To complete a job, one has to process the job ona 
machine for one unit, of time. Only one machine is available for processing 
jobs. A feasible solution for this problem is a subset J of jobs such that each 
job in this subset can be completed by its deadline. The value of a feasible 
solution J is the sum of the profits of the jobs in J, or E;_; p;. An optimal 
solution is a feasible solution with maximum value. 

Refer to Prob.19. 


0.20. 


4 


Q.21. Explain how job sequencing with deadline can be solved using 
(R.GP.V., June 2014) 


Ans. To formulate a greedy algorithm to obtain an optimal solution, we 
must formulate an optimization measure to determine how the next job is 
chosen. As a first attempt, we choose the objective function 2;_; p; a8 our 
optimization measure. Using this measure, the next job to include is the one 
that increases Z,_, p; the most, subject to the constraint that the resulting J is 
a feasible solution. This requires the jobs to be in non increasing order of p,’s. 

One way to determine whether a given J is a feasible solution, is to try out 
all possible permutations of the jobs in J and check whether the jobs in J can 
be processed in any one of these permutations (sequences) without violating 
the deadlines. For a given permutation 6 = iy, in, igs «+++ ly this is easy to do, 
since the earliest time job i,, 1 <q$ k, will be completed is q. If q> dj, then 
using 6, at least job i, will not be completed by its deadline. However, if |= 
i, this requires checking i! permutations. Actually, the feasibility of a set J can 
be determined by checking only one permutation of the jobs in J. This 
Permutation is any one of the permutations in which jobs are ordered in non 
decreasing order of deadlines. 

2.22. Write an algorithm for job sequencing problem with deadline. 
Also discuss its complexity. (R.GRV, Dec. 2013) 

Ans. The algorithm is given in algorithm 2.5. 

i Algorithm 2.5 Greedy Algorithm for Sequencing Unit Time Jobs 
with Deadlines and Profits. 
- Algorithm JS (d, j, n) 
/lA{i] = 1, 1 <i <nare the deadlines, n 2 1. The jobs 
// are ordered such that p[1] 2 p[2] 2 --- 2 plo). Ji] 
// is the i job in the optimal solution, 1<i<k. Also 
// at termination d[J[i]] < d{fi + 1], 1 <i<k 


1 
2, 
= 
4 
5 
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mean by sii P 
. { 40] : = 0; /nitalize 0.23. ae ” Sh ns ? Explain. 
: . Job 1 Ans. Graphs can > represent the highway structure of a state or 
8. ; // Include country with vertices representing cities and edges representing sections of 
9. highway. The edges are assigned weights which may be either the distance 
10. fori: =2tondo between the two cities connected by the edge or the average time to drive 
ll. { along that section of highway. A motorist wishing to drive from city A to B 
12: //consider jobs in nonincreasing order of p[i]. Find would be interested in answers to the following questions — 
13. /iposition for i and check feasibility of insertion, ()_ Is there a path from A to B? 
14. =k; (ii) If there is one or more paths from A to B, which is the shortest 
: Se, i r= ath ? 
ae wile (attr is aD = oa dose WP These problems are the special cases of the path problem. The length of 
16. if(d{J[r}] < d[i]) and (d[i] > 1) then a path is now defined to be the sum of weights of the edges on that path, The 
17. { starting vertex of the path is referred to as the source, and the last vertex the 
18. /Ansert i into J[ J destination. In the problem we are given a directed graph G = (V, E), a weighting 
19, for q: =k to (r + 1) step — 1 do J[q + 1]: = J{q}; function cost for the edges of G, and a source vertex vp, The problem is to 
20. Jt l):=i;k:=k+1; determine the shortest paths from vo to all the remaining vertices of G. It is 
21 } assumed that all the weights are positive. The shortest path between vy and 
22. } some other node v is an ordering among a subset of the edges. Hence, this 
: problem fits the ordering paradigm. 
23. retum k; For example, consider the directed graph of fig. 2.5 (a). The numbers on 
24, } the edges are the weights. If node 1 is the source vertex, then the shortest 


path from | to 2 is 1, 4, 5, 2. The length of this path is 10 + 15 + 20 = 45. 
However, there are three edges on this path, it is shorter than the path 1, 2 
which is of length 50. There is no path from | to 6. Fig. 2.5 (b) lists the 
shortest paths from node | to nodes 4, 5, 2 and 3 respectively. 


For JS there are two possible parameters in terms of which its co: 
can be measured. We can use n, the number of jobs, and s, the number! 
included in the solution J. The while loop in this algorithm is iterated at 
k times, Each iteration takes @(1) time. If the if condition is true, then lit 


solution, then the total time needed by Uporithm JS is @(sn). Since s $B 
worst-case time, as a function of n alone is @(n2). If the job set is P;* 
n—i+1,1<i<n, then algorithm JS takes @(n2) time to determine J. 
the worst-case computing time for JS is ©(n2). In addition to the space 
for d, JS needs ©(s) amount of space for J. 

_ The computing time of JS can be reduced from O(n2) to nearly of 
pisces cea set union and find algorithms and a different mell® 
ae ae eels ofa Partial solution. If J is a feasible subset © 
ert cs the Processing times for each of the jobs using tt 
fie oh wie = oe a Processing time, then assign it to 

e largest integer r such that 1 <r < d, and ee 


[o-1, @) is free. Thi i : 
possible. This rule simply delays the processing of job i a 


(a) Graph (b) Shortest Paths from 1 
Fig. 2.5 Graph and Shortest Paths from Vertex I to All Destinations 


0.24. Write a greedy-based algorithm to generate the shortest paths. 
Or 


_ Write Dijkstra’s greedy algorithm to find the shortest path between two 
Sven vertices, 
Or 


Write and explain single source shortest path algorithm with example. 


(R.GP.V., June 2013) 
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Or 
th and find its co, ; 
ingle source shortest patl enh 
sing! (R.GP.V, May i 
m only determines the lengths of the shortest 
to all other vertices in G In the function shortest paths it is assumed 
from Vo to al 


: bered 1 to n. The set S is maintained as a bit 
the n vertices of G are numbe! S and S[i] =| if itis. It is assumed that the 


82 Analysis 
Write algorithm for 


Ans. Dijkstra’s algorithi 


Algorithm 2.6 Greedy Algorithm for Shortest Path 

1, Algorithm shortest paths (v, cost, dist, n) 

2. /Mist[j], 1 <j <n, is set to the length of the shortest 

3. //path from vertex v to vertex j in a diagraph G 

4, //with n vertices.dist[v] is set to zero. G is 

5. //represented by its cost adjacency matrix cost[1 : n, 1 : a}, 
6. { 

7. fori:=1tondo . 
8. { /Mnitialize S. | 
9. S[i]: = false; dist[i]: = cost [v, i]; 

10. } 4 
11. S[v]: = true; dist[v] = 0.0; //Put v in S. 

12. for num: =2 ton—1 do 

13. { 

14. //Determine n—1 paths from v. 

15. Choose u from among those vertices not in S such 

16. that dist{u] is minimum; 

17. S[u): = true; /Put u in Ss. 


18. for (each w adjacent to u with S[w] = false) do 
19. /fupdate distances 


= if{dist{w] < (dist{u] + costfu, w])) then 
o dist[w]: = dist{u] + cost{u, w]; 
ane | 
23. } 
The com 


plexity of the improved Version of Dijkstra’s algorithm , 


realized with 7 seas 

numsng time of (meee een te Of © (ng log(ny)), an ave 

Pi cera Ny-log(ny)), and a best-case time of © (n,), with ng 
er of edges and vertices in the graph, respectively. 
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0.25. Write Dijkstra’s algorithm. 


é Find the shortest Path between § and 
7 in the following graph. 


Fig. 2.6 


(R.GP.V., Dec. 2011) 
Ans. Dijkstra’s Algorithm — Dijkstra’s algorithm has a set S of vertices 
whose final shortestpath weights from the source s have already been 
determined. It means that for all vertices v € S, we have d[v] = &(s, v). The 
algorithm repeatedly chooses the vertex u > V —S with the minimum shortest 
path estimate, inserts u into S, and releases all edges leaving u. In the following 
implementation, a priority Q that contains all the vertices in V — S, keyed by 
their d values, It is assumed in the implementation that graph G is represented 
by adjacency lists. 
DIJKSTRA’s Algorithm — 
Initialize-SINGLE-Source (G, s) 
s<0 
Q<V[G] 
while Q¥0 
do u < Extract source MIN Q 
S<—SU {uy} 
for each vertex v € Adj[u] 
do RELAX (u, v, w) 
The execution of Dijkstra’s algorithm is shown below — 
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Therefore, )diqj = 414) + dogg + ...... + dio dio 
i=l 
= (4 x 28) + (3 * 32) + (5x 12) + (7x 5) + (2 x 84) + (3 x 53) 
+ (2 * 91) + 3 x 35) + (7x 3) +6 x 11) 
= 112 + 96 + 60+ 35 + 168 + 159 + 182 + 105 +21 +66 


ERICAL PROBLEMS = 1004 Ans, 
Prob.2. Find the optimal merge pattern for the following data - 

Prob.1. Find the optimal binary merge tree (pattern) for ten files 28, 32, 12, 5, 84, 53, 91, 35, 3, 11. 
length are 28, 32, 12, 5, 84, 53, 91, 35, 3 and 11. Also find its (R.GP.V., Dec. 2008, June 2009, Dec. 2009, 2012, 2017) 
external path length. (R.GP.¥., May/June 2006, Dec, Sol. Refer to Prob.1. 

Sol. For obtaining optimal binary merge pattern, merge two smallest Prob.3. What is greedy strategy ? Explain optimal merge pattern in 
files at each step. brief and find an optimal binary merge tree (pattern) for files whose lengths 

Fig. 2.8 shows a binary merge pattern representing the optimal my gre 28, 32, 12, 15, 84, 53, 91, 35, 5 and 11. (R.GP¥., Dec. 2013) 
pattern obtained for the above ten files. Sol. Refer to Q.1 and Q.6. 


Problem — The optimal merge pattern is given below — 


After Iteration 


Initial 28 32:12:15 HOSTS 
0) (16) 28 32 «12 «1S «8 53 9 3S 
Ls} 
‘Els © (16) 2 32-7) 45S 
Ls] By U2] Ls] 


28 32084 5H OS 


Fig. 2.8 
Weighted External Path Length — (©) (43) (60) 84 530 O35 
n 


dai (16) (27) [2s] [2] 


4; = Distance from the r 


where, 
‘oot to the 
i= The le fis external node 
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2 


nu 


1 
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prob.4. Find an optimal merge pattern for 11 files whose length 
22 i 5 SDs Sp 3 Sh Ue re are explain the alzorithe ieee 


determine its complexity. oe 
Sol. The optimal merge pattern is given below — 


eet He amen aq +I, 12, 28, 32, 35, 84 
oe 2 a we w aT 


(o) es 1M, 12, +28, 32,3584 (d) 12, (15) neon 
ao [s] a [>] fA oO a yy 
Ls] a 


in +28, 32, 35, 84 a 28, 32, 35, 
Da} [2] Ss 
Ls} Ls} ine o 
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Fig. 2.10 
Algorithm and Complexity — Refer to Q.6. 


Prob.5. Obtain a set of optimal Huffman codes for the seven m 
(My wy Mz) with relative frequencies (q Jy....-, 97) = (4, 5, 7, 8, 10, 12, 
Draw the decode tree for this set of codes. 

(R.GP.V., Dec. 2006, June 2009, Dec. 

Sol. There are seven messages (Mj.....M7) with relative 
(41-47) = (4, 5, 7, 8, 10, 12, 20). Now first we draw its equivalent tret) 


init GG] Ha &@ & 
Ho & a 


(a) 


(b) 


QO & a 


Le] G& [3] 
(© (19) (3) 
Onn rs] 
Lf] 


Ee] Bl 


Unit- 11 89 


(@) 


(e) 


Optimal Huffman Codes — 


Messages Codes 


M - 1000 
M, - 1001 
M; - 010 
My - oul 
Ms - 101 
Me - 00 
M, - 1 


Prob.6. Obtain a set of optimal Huffman codes for the seven messages 


Dat --M;) with relative frequencies (q p47) = (4, 5, 7, 8 10, a aD 
"aw the decode tree for this set of codes. (R.GRK, June : 

Sol. There are seven messages (Mj.....:-.-M;) with relative frequencies 

Une) = (4, 5, 7, 8, 10, 22, 15), Now first we draw its equivalent tree. 
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Initial — 


@ fo 
(b) 
C7) 


-Sem.) 
oo 
oo od 2! 


fo 2) os 


ie ” ~) Bi 
@) oy Ee 


Ca] C3] 
‘d) (19) G0) 
[4] Cs] [7] Cs] 


Thus coded tree is represented as 


Fig. 2.12 


Optimal Huffman Codes — 


Messages 


M; 
M, 
M3 
Mg 
Ms 
Mg 
M; 


Codes 
1000 
1001 
000 
001 
101 
rie 
or 


Huffman code. 
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Prob.7. Construct a Huffinan code for the following data — 
B\C|D|E 


Character | A 


Probability | 0.4 | 0.1 | 0.2 | 0.15 | 0.15 


Decode the text whose ending 100010111001010 using the above 
(R.GP.V., Dec. 2016) 
Sol. There are five characters (A, B, C, D, E) with relative frequencies 
(0A, 0.1, 0.2, 0.15, 0.15). 
Now, first draw its equivalent tree 


Initial B D E c A 
O15 015 02 04 


o @ A 


@ 
Optimal Huffman Codes 
A - 1 
B - 000 
c - on 
D - 001 
E - 010 


Message Decoding — 
1,000 1 011 1 001 010 


ABACAD E 
Hence, the required message is ABACADE. Apt. 


it /-Sem. 
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Prob.8. Apply Prim’s algorithm to the following graph, Write wl 
rob.8. 


complexity. Find the minimum cost. 
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From node 5 the smallest value is 23, therefore edge (5, 7) will be taken, 


nD 
(6) 


3D) 


25, 


©) 


Fig. 2.15 (c) 


de 7 the smallest value is 15, therefc d, i 
Fig. 2.14 (R.GRY., May 1) Bromley ‘ore edge (7, 2) will be taken, 


Sol. Prepare the Prim’s table to find the minimum cost. 


7 | © 143} © 0 


Here number of nodes are 7. Therefore total number of edge in spas 


tree will be 6. 


Fig. 2.15 (d) 


From node 2 the smallest value is 16, therefore edge (2, 3) will be taken, 
Since (2, 7) is already taken. 


We start a tree that include minimum cost edge is, (1, 6) as show Fig. 2.15 (e) 


above table. 
1 ©) 
© 
Fig. 2.15 (a) 


From node 6 we 
therefore we take (6, 5). 


wo 
(<) 


25, 


Fig. 2.15 (b) 


can choose (6, 1) or (6, 5). Since (6, 1) is already) 


From node 3 the smallest value is 10, therefore edge (3, 4) will be taken, 


Hence the minimum cost spanning tree is as follows — 


Fig. 2.15 () 
Minimum cost = 10 + 25 +23 + 15+ 16+ 10=99 Ans. 


| For complexity, refer to Q.12. 
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Prob.9. Find minimum spanning tree using Prim’s algorithm Sor y 


given below — 


(RGBY., June ») 
Sol, Fig, 2.17 shows the execution of Prim’s algorithm on the 


from fig. 2.16. Minimum spanning tree of the given graph is fig. znd 


@) 16 


Fig. 2.17 


The minimum cost is 56. 


Prob.10. What is minimum Spanning tree ? Using Prim’s a 
Sind minimum spanning tree of the following graph — 


Unit - Il 9 
Sol. Minimum Spanning Tree — Refer to Q.11, 
problem — Fig. 2.19 shows the execution of Prim’s algorithm on the grapk 
from fig. 2.1 8. The resulting minimum spanning tree is shown in fig. 2.19 (e), 
having cost 21. 


(@ 
Fig, 2.19 
Prob.11. What is greedy strategy ? Write Prim’s minimum cost spanning 
tree algorithm. Determine MST for the following graph. 


(R.GP.V., Dec. 2012) 
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Sol. Greedy Strategy — Refer to Q.1. 
Prim’s Algorithm — Refer to Q.12 


Fig. 2.21 shows the working of Prim’s method on the gra 
2.20. The resulting minimum spanning tree is shown in fig. 2.2) ae 


cost 93. 


© © 


© ©-o® 
© 


(@ 


(B.E., IV-Sem.) 


© 


© 


© 


14 


(b) 


© 


Prob.12. Apply Kruskal’s and Prim’s algorithm Unit - 11 97 


write their time complexities. Find the minimum 


for the followi 
win 
cost in each phage?” 


Fig. 2.22 


Sol. Kruskal’s Algorithm — The i 
for the given fig, 2.22 is shown in fig. eas Seeks alporitha 


2 
() 6) © 

© © o) 
od oo ® e 


(R.GRV., May 2019) 


f Algorithm (B.E., 1V-Sem.) 
Minimum Cost = 10+12+14+ 16+22+25=99 
Time complexity of Kruskal’s algorithm is O(log V) 


where V = Number of vertices. 
Prim’s Algorithm — The execution of the Prim’s algorithm hel 


fig. 2.22 is shown in fig. 2.24. 
ae 0 
© © 
25 25, 
OrO Ort 
(© ( 
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@) 
rT) 
©) 


25 


Fig. 2.24 


Minimum Cost = 10 + 25 + 22 + 12+ 16+ 14=99 
Time complexity of Prim’s algorithm is O(V2) 


Prob.13. Find an optimal solution to the following Knapseck 4 


Number of objects n = 3 
Knapsack capacity m = 20 
Profits (pj, Pz P3) = (25, 24, 15) 
Weights (wy Wy w3) = (18, 15, 10). 
(R.GRV, Jit 
‘ Or 

Find an optimal solution to the Knapsack instance 1 = 3,m 

Py P3) = (25, 24, 15) and (wp Wy, w;) = (18, 15, 10). (R-GPYs 


2) onh . ‘i 
Y 10 units, so the fraction we will have is 8 X2~ 7 


i Unit-I 99 
i Knapsack proble: 
sol. For solving above psack problem, we use som 
termine the fraction of weight which should be included so iin 4 
i profit and fill the Knapsack completely, oe 
(Xs X2° X3) Ewix; Ep,x; 
a fa *) 16.5 
=,=,- g 24.25 
re) ( sar 
i) 12.0) 20 28.2 
15 
2 
win) (0,251 20 31 
(iii) ( 3 ) 
20 315: 


(iv) (0 1, ;) 


There are four feasible solutions given above. 

(i) At each step, we try to get the maximum profit. The maximum 
profit we get by object of profit 25 and weight 18. So, we place it in Knapsack 
first by having x, = 1. Now, profit is 25, and weight is 18. Total capacity of 
Knapsack is 20. The next maximum profit we can have 24, having weight 15, 
but we have only 2 units of weight. So a fraction of this object will be added 


i.e, X= 


5° 
Now, fraction of profit that we get is 24 xz = 3.2. 


Total profit gain is 25 + 3.2 = 28.2. And total weight is 20 equal to 


.|capacity of Knapsack. 


The method used to obtain this solution is termed as greedy method, 
because at each step (except possibly the last one), we choose to introduce 
that object which would increase the objective function value the most. 
rom (ii) In above method, although we try to maximize the object 

inction value, but it does not result into a optimal solution, as weight increases 
Tapidly at each step and we are not able to maximize the profit. 
So, in this approach, we i ject in order of nonde 
ight + , we include the object in order 
Weight w;. PP’ in z 


By above method, first we include object 


ive 


creasing 


of minimum weight, ie. W3; 
15. Now, the total capacity of 


“180 X3 = 1. Its weight i in is 
eight is 10 and profit we gain ! te weight. FOr this, include 


10 un 
tt 15 and pro! 


10. 
= — i.e, X= 
5 2 


Kn; a 
‘apsack is 20, so we are left with only 


Next mini . . . it we have 
minimum weight object w2 having weight fit 24. Bu 


a) 
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ins 24 x == 16 Unit = 101 
Now, the profit we gain 1s 24 x > : ‘al. To solve this soon we use some strategy to determine the fraction of 
i = i id be included so as to maximize the profit 
=16+15=31. P t which shoul profi adr 

Tal peewee ad (x1, X20 X3» X4y X5> Xr X7) Iw3ix; Zpix; ipsack, 
otal ‘3 =: . f 
i Seer ee: 

(iii) Even after reducing the rate of capacity used at cach @ G > ar ee 5.51 fice 


are not getting an optimal solution. For this, now: We try'to achieve g taking maximum profit 18 with weight 4 as — 


between the rate at which profit increase and the rate at which Now 
‘i : A = 1, Zwixj < m. 
used. For this, at each step we include that object which has the XG OF F 
profit per unit of capacity used. This means objects are considered in (i) G: a et Swe. L ;) 8.51 31.19 
ratio Pi/Wi, i., the object having maximum profit per unit weigh ? 3 4 5°6 8 
used first. j ai (: 1 yl IM 5) 12.69 42.44 
profit 25 2 3 56 8 
In our example, 18 object has ———— = ——=13 1 11 1 
weight 18 (v) (. &, | 7] 13.69 41.44 
2nd object h profit, _ 24 16 , ‘ 1 
oplest aes weight 15 6 (ue ) 14.52 52.44 
3 = 8 
: profit 15 _ 
3d object has weight av aa 1.5 (vi) (. + I a i, Uj. i) 15 54.67 
So, maximum profit is in case of 2"4 object, and we include a 2 
xy = 1. Now, weight is 15 and profit is 24. Further, we add object # (vii) (. zh 0, 1, 1, 7 15 55.33 


1 i At each step, we try to get the maximum profit. The maximum profit we 
used is .The weight added is —-=5 and profit is eS . 75. Total pel** by step (vii) taking X1 = 1, Xp = 2/3, x3 = 1, X4 = 0, Xs = 1, X6 = 1, and 
2 2 2 X7 = 1. These fraction of weight provided maximum profit. This is the best 


next highest profit, but we are left with only 5 units, so fraction of' 


24+ 7.5 =31.5. solution, with maximum profit. 
ais te is the best solution, with maximum profit. Greedy Knapsack Prob.16. Consider the Knapsack instance n = 3, (W1, Wz, 3) = (2,3, 9 
.5 also uses the same method. land (p;, p2, p3) = (1, 2, 5), m = S. Find the optimal solution. 
Prob.14, What is Knapsack problem ? Find the optimal solution (R.GPV., June 2009, 2013) 
Sol. For solving the Knapsack problem, we use some strategy to determine 


Knapsack instance n = 3, m = 20, the fracti 
@r Px P3) = (25, 24, 15) and (wy wy w3) = (18; 15,10) lana Cay se omnes Sf = —ee 
letely. 
(RGR, Dec. 20! me Pigs x3 Zwixy [PAX 
Sol, Refer to Q.16 and Prob.13. ; (i) 1 u q 3 2.42 
_ Prob.Is. Find the optimal solution of the Knapsack instance 3° 4 ; 
1 5 155 oy Pp meen B) = (10,5, 15,7, 6, 18, 3) and (Wy MP dy oo 4, 1 5 567 
= (2, 3,5, 7,1, 4, D. (2.GR¥., May/June 2006, Dee. Gi) 1, 1 0 5 s 
-* i : E 
i 1 (vy) 0, 4, + 5 Ae 


Consider n = 7, m = 15, (P,, P 7,6 8, 

; 5) (Py, Py, vxuny Pz) = (10, 5, 15, 7 6! ; 
Wp Wo wes Wy = (2, 3, 5,7, 1, 4, D. Paice - opiteaal solution wis Maximum profit we get by (ii) taking x; = 0, X= 1/3.% = | These 
Knapsack instance. (R.GPVs De °n of weight provided maximum profit is the optimal solution. 


Pro! 
objects are as follows 
Weight w;- 

Value p; ? 


Solve the Knapsack problem using greedy strategy ang th 
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5.17. A Knapsack capacity is 100. The weights and Valu, 
ane y 


10 20 30 40 50 
20 30 66 20 60 


maximum profit that can be obtained. (R.GPY, Jane 
Sol. We have 
n=5 
m= 100 


(1s Pa» P3> Pa» Ps) = (20, 30, 66, 20, 60) 
(W1, Was W3, Wa, Ws) = (10, 20, 30, 40, 50) 
First arrange all the elements in the order such that 


pli] pli+t] 

wii] > wli+l) 

PU _ 20 _ PI) _ 30 _ 
80% wil] ~ 10 ~7 w[2] ~ 20 ~ 

PB) 66 _ Pia] _ 20 _), 

wi3] 30 w[4] 40 

PIS] _ 60 _ 

wh] ~ 50 ~ 12 


So arrangement will be 
(P3, P1, Pas Ps» P4) = (66, 20, 30, 60, 20) 
(W3, Wy, W2. Ws, W4) = (30, 10, 20, 50, 40) 
Initially, (x, x9, X3, X4, Xs) = (0, 0, 0, 0, 0) 
Now as per the algorithm U = 100 
Take p; and w; 
Check weather w3 > U (i.e., 30 > 100) 
No, so we continue 
x[3] = 1.0 and 
U=U-w; =100-30=70 
Now, take p; and Ww 
Check weather w, > U (10 > 70) 
No, so we continue 
x[1] = 1.0 and 
U=U-w, =70-10=60 
Now, take p, and w 
Check weather w, > U (ie., 20 > 60) 


nue 
x[2] = 1.0 and 
U=U-—w, = 60 -20=40 
ow, take ps and Ws 
pail weather ws > U (i.e., 50 > 40) 
Yes, so We break. 


No, so We conti 


Now clearly there are still some profit and weight left so 
eis 
x1= Ws 50° 5 


4 
1,0,= 
‘ (un) 


4 
Ewix; 10 +20 +30+0+50% = = 100 
4 
Epix 20 +30 + 66 +0 + 60x = = 164 


Maximum profit = 164. 


four items are as follows — 


Item 


Profit P; 
Weight W; 


Sol. We have 
n=4 
W=60 
(P,, P2, Ps, P4) = (280, 100, 120, 120) 
_ OWL, Wa, W3, Wa) = (40, 10, 20, 24) 
First arrange all the elements in the order such that 


PL) Pli+t) 
Wii] > WEi+l] 
So PO] — 280 | 
Wil] 40 — 
PRI 100 | 
WI] ~ 10 ~ 
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So, the maximum profit of Knapsack problem by using greedy strategy 


Ans. 


Prob.18. A Knapsack capacity is W = 60. The weights and profits of 


Solve the Knapsack problem using greedy strategy and find the 


_|maximum profit that can be obtained. (R.GRV., Nov. 2018) 
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PB] 120 Unit-i 105 
= je those profits (P;,., P,) = 

—S = = 19 There are 5 jobs w pI 1++ Ps) = (20, 15,10, 1, 6 

Wi] 20 Z = 2,24, 3,3. Find the optimal solution that maximizes sa ie 

P[4] 120 nedulin these jobs. Discuss its algorithm too. (R.GPY, June 2011, 2013) 

ee sc 

Wi4] 24 Sol. 


Assigned Slots _| Job Considered | Action _| 


So arrangement will be 


= 1 assign to [1, 2 
|, P3, P,) = (100, 280, 120, 120) none ign to (1, 2] 
a . i a (10, 40, 20, 24) a [I, 2] 3 assign to [0, 1] 
» Wi, W3, Wa , 40, 20, Lael 
Italy, (XX Xs X= (, 0, 0, 0) Vea era, 2) 4 a 
My Are ay Aas “Me {1, 2} [0, 1], Ul. sign . 
Now as per the algorithm U = 60 feud fa, 2,43 (0, 1], U1, 21, 2, 3) 5 reject 


Take P, and W2 


Check weather Wz >'U (i.e. 10> 60) Prob.20. Write a greedy algorithm for sequencing unit time jobs with 
No, so we continue deadlines and profits. Using this algorithm, find the optimal solution when n= 5. 


X(2] = 1.0 and 


U=U-W,=60-10=50 Pi 20 2 
P2 15 2 
p; | 10 1 
P4 5 3 
Ps 1 3 3 
(R.GRY, Dec. 2016) 


Now, take P; and W, 
Sol. Algorithm for Job Sequencing Problem — Refer to Q.22. 


‘The optimal solution is J = {1, 2, 4} with a profit of 36. 


Check weather W, > U (40 > 50) 
No, so we continue 
X[1] = 1.0 and 
U=U-W, =50-40=10 
Now, take P; and W; 


P. at 
Check weather W; > U (20 > 10) oie’ ; 
Yes, so we break. we have, n= 
Now clearly there are still some profit and weight left so (1, Pas P3, Pqs Ps) = (20, 15, 10, 5, 1) 
U_10_1 (iy day dy, dy, ds) = @, 2, 1,3, 3) 
X31= Ws “202 j So, by using the feasibility rule described in Q.22, we have 
So, the maxi ; . 
0, the maximum profit of Knapsack problem by using greedy J | Assigned Slots | Job Considered | Action Profit | 
X= ( 1 = 0 ¢ None 1 assign to [1, 2] 0 
' a 0,2] 2 assign to[0, 1] | 20 
©2) | for fit: reject | 35 
, 1, [1,2] 3 cannot fit : rej 
EWiX\= eee IU, 
_ 2X = 40 + 10 + 20 x 7 +0=60 a (0,1],01,21 4 assign to [2, 3] 34 
22,4} | [0, 1), (1, 2], [2, 3] 5 reject 4 


EPiX; = 280 + 100 + 120 x a +0=440 
Maximum profit = 440 The optimal solution is J = (1, 2, 4) with profit of 40. 


Igorithm (B.E., 1V-Sem. ) 


DE 
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Prob.21. There are 5 jobs whose profits i a i Po Ps) = (69, ni 
40, 20) and deadlines (Dy, Dy Dy Dp Ds) = 2, 1, fe 1). Find the 
solution that maximizes profit on scheduling these jobs. (R.GRV,, Nox 

Sol. Here we have, n = 5 

(Pj, Pa, P3s Pay Ps) = (60, 100, 20, 40, 20) 
(Dj, Dz, Ds, Dg, Ds) = 2, 1,3, 2, ; 

The given jobs are sorted according to their profit ina descending 

Hence, after sorting, the jobs are ordered as shown in below — 
a ee 
Deadline | 1 2 | 2 | si 1 
Prot | 100 | 60 | 40 | 20 | 20 

From this set of jobs, first we select J, as it can be completed With 
deadline and contributes maximum profit. 

Next, J; is selected as it gives more profit as compared to J,. 

In the next clock, J, cannot be selected as its deadline is over, hence} 
selected as it executes within its deadline. 

The job J; is discarded as it cannot be executed within deadline, 

Thus, the solution is the sequence of jobs (J, J,, J;), which are ty 
executed within their deadline and gives maximum profit. 

Total profit of this sequence is 100 + 60 + 20 = 180. 

Prob.22. Solve the following instances of the single source shortes| 

problem with vertex ‘a’ as the source. 


4 
Fig. 2.25 (R.GP. hy bec 
‘Sol. The value of distance and the vertices selected at each iters!®} 
the for loop for finding all the shortest path from node a is shown in table 


Table 2.2 Action of Shortest Path 


Vertex |__ Distance _| 
Selected | a | une [4[e| 


Bi : 
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prob.23. Find the shortest path from vertex 1 to vertex 3 in the 
jghte! d graph using Dijkstra’s greedy algorithm. 
weil 


following 


Fig. 2.26 (R.GP¥, Dec. 2014) 
Sol. The execution of Dijkstra’s algorithm is shown in fig. 2.27. 
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Prob.24. Write Dijkstra’s algorithm to find the shortest path 4, js 


given vertices. Using this algorithm find shortest path from vertex 1, 


3 in the following weighted graph. 


Sol. Refer to Q.25 and Prob.23. 


(R.GRY, Dee y 


" 


DT 


CONCEPT OF DYNAMIC PROGRAMMING, PROBLEMS 
BASED ON THIS APPROACH SUCH AS 0/1 KNAPSACK, 
MULTISTAGE GRAPH, RELIABILITY DESIGN, FLOYD- 


WARSHALL ALGORITHM 
Q.1. Define dynamic programming. (R.GPV, June 2015) 
Or 


Write short note on dynamic programming. 
(R.GP.V, Dec. 2015, June 2016) 
Or 
Explain the concept of dynamic programming. (R.GPV., Dec. 2016) 


Ans. Dynamic programming, like the divide-and-conquer method, solves 
problems by combining the solutions to subproblems. 

As divide and conquer algorithms partition the problem into independent 
subproblems, solve the subproblems recursively, and then combine their 
Solutions to solve the original problem. While, in contrast, dynamic 
Programming is applicable when the subproblems are not independent, that is, 
when subproblems share subproblems. In this context, a divide and conquer 
algorithm does more work than necessary, repeatedly solving the common 
Subproblems, : 

A dynamic programming algorithm solves every subproblem just once 
and then saves its answer ina table, thereby avoiding the work of recomputing 

© answer every time the subproblem is encountered. 

Dynamic programming is an algorithm design method that can be ned 
When the solution to a problem can be viewed as the result of a sequence of 
decisions, Dynamic programming is typically applied to optimization problems. 
In such problems there can be many possible solutions. Each solution 
ie @ value, and we wish to find a solution with the optimal (minimum or 
maximum) value. 
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0.2. Give some examples where dynamic programming can be 
Ans. Dynamic programming can be applied in all the situations wi 
solution to a problem can be viewed as the result of a sequence oF degh 
Some of such problems are as follows — 


(i) Optimal Merge Pattern —\n this pattern, we have to 
pair of files at each step. Here, we have a decision sequence, ie, 
determination about the files that should be merged at each step, Sov, 
apply dynamic programming in this case. 4 

(ii) Knapsack Problem —In this problem, we are given q 
with a given capacity m, and some objects each having some cml 
and profit. 

At each step, we have to decide the values of x;, 1 <i <n. First we 
a decision on x, , then on x, and so on. Keeping a goal to maximize the 
and Ew;x; < m, with a constraint 0 < x; < 1. 


(iii) Shortest Path Problem —In this problem, we try to find the mini 
distance, i.e., the shortest path between vertex i and j. At each step determin 
next shortest path. So we apply dynamic programming to above problem. 

The main concept behind dynamic programming is principle of opti 
which states that an optimal sequence of decisions has the property 
whatever the initial state and decision are, the remaining decisions must 
an optimal decision sequence with regard to the state resulting from the’ 
decision. 7 

We apply this on shortest path problem, Here, we assume initially! 
+» iy j is a shortest path from i to j.That means starting 
Position i, we first go to vertex ij. } 

Following this decision, new decision is to be made, stating the pr 
to find to shortest path from vertex i, to j. According to principle of op 
the sequence ij, i,, i,, j must constitute a shortest i, to j path. 4 

If not, let ip Ty Tyyesnneeents fq; be a shortest i to j path. Thea! 
seeenen » Tq, J 1s an i to j path that is shorter than the path i, ij, iz 
Therefore, principle of Optimality applies to this problem. 


“9 


0.3, Explain dynamic Programming concept with example. 
(R.GRV, June 2004" 
Or 
ing with example. 
(R.GP.V., Dec: 


Explain dynamic Programm 


20098" 
Ans, Refer to Ql and Q.2. 
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Q.4. Write the characteristics of dynamic Programming, 


(R.GPY, Dec, 2014) 
‘Ans. Some characteristics of dynamic Programming are as follows — 

(i) The problem can be divided into stages, with a Policy decision 
required at each stage. 

(ii) Each stage has a number of states associated with the beginning 
of that stage. 

(iii) The effect of the policy decision at each stage is to transform 
the current state to a state associated with the beginning of the next stage. 

(iv) The solution procedure is designed to find an optimal policy for 
the overall problem. 

(v) Given the current state, an optimal policy for the remaining 
stages is independent of the policy decisions adopted in previous stages. 
Therefore, the optimal immediate decision depends on only the current state 
and not on how you got there. This is the principle of optimality for dynamic 
programming. 

(vi) The solution procedure begins by finding the optimal policy for 
the last stage. 


0.5. What is principle of optimality ? Explain with suitable example. 
(R.GP.V., June 2014, Dec. 2014, 2015) 
Or 

Explain principle of optimality. 


Ans. The principle of optimality states that an optimal sequence of decisions 
has the property that whatever the initial state and decision are, the remaining 
decisions must constitute an optimal decision sequence with regard to the 
State resulting from the first decision. 


Example — Consider a shortest path problem where one way to find : 
shortest path from vertex i to vertex j in a directed graph G is to decide whic 
Vertex should be the second vertex, which the third, which the fourth, Fi - 
On, until vertex j is reached. An optimal sequence is one that results - a el “= 
least length. Assume that i, ij, ig, ++ , ity j is a shortest path pr s et 
Starting with the initial vertex i, a decision has been made to go ia i by 

ollowing this decision, the problem state is defined by vertex i an an 
'0 find a path from i to j. It is obvious that the ee ites a ef ie 
‘rm a shortest i, to j path. If not, let ij, Tt» f=» Tar ol 
Path. Then i, ij, ., mies , jis an itoj path that is shorter tn ee 4 
"2 sy ig, je Therefore, the principle of optimality applies for “ 


(R.GR¥., June 2015) 


E,, IV-Sem.) 
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? Compare it with Sreedy yy, 
Q.6. What is dyna 


mic programming (R.GPY, Der 


Ans. Refer to Q.1- method and dynamic programming 


Comparison between greedy 
are as follows — 
Greedy Method 


Tt first make an optimal choice, 
without knowing solution to 
subproblems and then solve 
remaining subproblem (s). 
It follows top-down technique. 
It does not use principle of 
optimality. 
A greedy method suggests that 
one can devise an algorithm that 
works in stages, considering 
one input at a time. At each stage 
a decision is made regarding 
whether a particular input is an 
optimal solution. 

Q.7. Discuss the elements of dynamic programming. 

Or 

What are the key ingredients that an optimization problem must 

for dynamic programming to be applicable ? Explain them. 
(R.GR.V., Dec. 

Ans. There are two key elements that an optimization problem mut 
for dynamic programming to be applicable. They are = 
(i) Optimal substructure 
(ii) Overlapping subproblems. 


Dynamic Programming 


It solve subproblems first, 
use those solution to make a 
optimal choice. 


It follows bottom-up technigy 
It uses principle of Optimality, 


Dynamic programming is an 
algorithm design method that 
can be used when the solutioy 
to a problem can be viewed 
a result of a sequence of 
decisions. 


J 
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Jgorithm for the problem solves the same subproblems 
fan always generating new subproblems. Generally, 
subproblems is a polynomial in the input size. Now 
revisits the same problem over and over again, w 
roblem has overlapping subproblems, However, 
which as divide and conquer approach is suitable usi 
problems at each step of the Tecursion. Typically dynamic programming 
algorithms take advantage of overlapping subproblems by solving each 
subproblem once and then storing the solution or result in a table where it can 
be looked up when needed, using constant time per look up. 
Memorization is a variant method, for taking advantage 
subproblems property. Here the main idea is to memo) 
inefficient, recursive algorithms. 


over and over, rather 
the total number of distinct 
when a recursive algorithm 
© say that the optimization 
in contrast, a problem for 
ually generates brand-new 


of the overlapping- 
rize the natural, but 


A memorized recursive algorithm generally maintains an entry in a table 
for the solution to each subproblem. Each table entry initially contains a special 
value to show that the entry has yet to be filled in. When the subproblem is 
first encountered during the execution of the recursive algorithm, its solution 
is computed and then stored in the table. Every time, whenever the subproblem 
is encountered, the value stored in the table is simply looked up and returned. 


Q.8. Give the commonly 
algorithm, 


used designing steps for dynamic. ‘programming 
(R.GP.V., Dec. 2014) 

Ans. The development ofa dynamic programming algorithm can be broken 
4 sequence of four steps — 

@) Characterize the structure of an optimal solution. 

(ii) Recursively define the value of an optimal solution. 

(ii) Compute the value ofan optimal solution in a bottom-up fashion. 

(iv) Construct an optimal solution from computed information. 
sol Generally Steps (i) to (iii) form the basis of a dynamic programming 
einen fo 4 problem. Step (iv) can be removed if only the value of an optimal 
Solution is required. When we perform step (iv), we maintain additional 


u i . ee . 
nformation during the computation in step (iii) to ease the construction of an 
ptimal solution. 


into 


29. Define binomial coefficient. (R.GR¥., June 2015) 


shih ene ab The optimal substructure of a problem often k. Ans. We use the notation "C,, (read n choose k) to denote the number of 
t of subproblems to which dynamic programming can be “ombinations of an n-set. The binomial coefficient is given by 
: ii) Overlap; ! 
optimization ‘ioble of i tart = The second hea, al "CO, = Peet forO<k<n 
that the s ve for dynamic programming to be aP k\(n-k)! 


Pace of subproblems must be “small” in the sense that # 


it :, 1V-Sem.) 
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‘ — 
‘This formula is symmetric 19 
2C, = "Ca-k 


bin 
numbers are also known as 


and n—k— 


omial coefficients, due oa 


suas in the binomial expansion — 
i . n¢ xk yo 
yn = k 
«+ y) hart 
3 ramming solution for computing bingy, 
10. Give a dynamic prog’ Li 
ame (R.GPV:, Dee a 


Ans, Using dynamic programming approach, binomial Coefficient cay 
ns, : 
i i lation — 
ecursively by using the rel 
aan =mIq.,+™IC, forn>k>0 


"Cy ="C,=1 


er The algorithm 3.1 calculate binomial coefficient using dyna! 


programming. 
Algorithm 3.1 
Algorithm Binomial (n, k) 
for i=0tondo 
fori to min (i, k) do 
ifj 0 orj==i then 
Cli, jJJ=1 
else 
Cli, j] = Cli-1,j-1] + Cfi-1,j] 
return C[n, k] 


Q.11. Discuss 0/1 Knapsack problem. 

Ans. 0/1 Knapsack problem is similar to Knapsack problem, hc 
discussed earlier with slight difference, i.e., here we are given 4 fit 
with capacity m, and few objects each with different weight and pro 
X; is restricted to have value either 0 or 1, a fraction is not allowe® 

We can represent the Knapsack problem KNAP (1, j, y) 8 


(R.GRV, June 


Maximize )* i<j pix; 
Subject to > Isisj Wixi SY 
Xi=0 orl, 1sisj ’ 
‘ fey 
We can write Knapsack problem as KNAP (i, 1, m), whe 


number of objects, and mis capacity of Knapsack. We have to fine 
Sequence of 0/1 values for X yy XQyeeeeey Xe 7 


b 7 Unit = 145 
Suppose Y}> Y2s-+-+++» Yq bE an optimal Sequence of 0)/] 
Mespectively. If y; = 0 then Yon Vay oe valu 
Es ence for the problem KNAP (2,n,m). 


seq 
If it does not, then y,, yo, ...... , yp, 


problem KNAP (1, n, m). 

On the other hand if yy = 1, then Yotin. Yq must constitne an optimal 
sequence for the problem KNAP (2,n, m— W)). If it does not, then there is 
another 0/1 sequence 


z, such that Dwizi Sm-wy, and 


es for Xp Xp, 
“++ Y, Must Constitute an optimal 


1s not an optimal Sequence for the 


Ly % 
2sisn 
Yvizi dpi 
2sisn — 2Sign 


--s%q iS a Sequence for equation (i) with 
optimality applies, 


Hence, the sequence yj, 2, 23, ... 
greater value. So, here also principle of 


Q.12. Show that greedy strategy will not work ‘for 0-1 Knapsack problem, 
Give a dynamic programming based solution Sor this problem. 
(R.GRV, June 2008, 2013) 


Ans. To see that the greedy strategy does not work for the 0-1 Knapsack 
problem, consider the problem instance shown in fig. 3.1 (a). There are 3 
items, and the Knapsack can hold 50 pounds. Item I weighs 10 pounds and is 
worth 60 dollars. Item 2 weighs 20 pounds and is worth 100 dollars. Item 3 
Weighs 30 pounds and is worth 120 dollars. Thus, the value per pound of item 
1 is 6 dollars Per pound, which is greater than the value per second of either 
item 2 or item 3. The greedy strategy, therefore, would take item 1 first. As 
can be seen from the case analysis in fig. 3.1 (b) however, the optimal solution 
takes items 2 and 3, leaving 1 behind. The two possible solutions that involve 


item 1 are both suboptimal. 


$120 
item 3 
s120 
item 2 + f ‘$100 
+ 
item I + 
$100 FF = < 
. = =$160 = $180 
S60 $100 $120 Knapsack $220 F s 
@ 
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ot work in the 0-1 problem because the pe 
i ty space lowers th 
to capacity and the emp a 
apsack to cap’ 1 problem, when we consider an 


f his load. In the 0- 2 ity 
Nar ip oy seaeee we must compare the solution to the subprg i 
inclusion 


i ke the choice, Th 

i “am ig excluded before we can mak . The 
sas big baer gives rise to many overlapping subproblems a 
asi programming and indeed, dynamic programming can be BS 
o 


solve the 0-1 problem. 
Dynamic Programming Solution to 0/1 Knapsack Problem ~ 


to Ql. 
Q.13. What is the difference between greedy Knapsack and 0/1 


ic imal solution, 
Show that 0/1 Knapsack solution not be an optimal 
iia (R.GP‘, Dec. 2008, June 2009, Dec, », 
Ans. Difference between Greedy Knapsack and 0/1 all 
essential difference between greedy Knapsack and 0/1 Knapsack is thatia 
greedy method only one decision sequence is ever generated. In 0/1 
many decision sequences may be generated. However, sequences, conti 
suboptimal subsequences cannot be optimal and so will not be generatei| 
Greedy Knapsack solves the problem by choosing the item with hi 
ratio at each step and it also allows the fraction of item to maximise the 
Whereas 0/1 Knapsack solves the problem by either selecting each ies 
whole or none. 
: Proof — Let fi(y) be the value of an optimal solution to KNAP (Ii 
Since the principle of optimality holds, we obtain 
fm) = max {f,_;(m), f,1(m — wa) + Pp} 
For arbitrary f(y), i > 0, equation (i) generalizes to 
. £0) P max {f.4(9), fi (y — w)) + p} 
uation (ii) can be solved for f,(m) by beginning with the 
ea in yy beginning wii 
fo(9) = 0 for ally and f(y) = —co, y<0. Then f), fy «ns fy can be SU 
computed using equation (ii), 
When the w. 
Sm. Since f(y) = 
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Taking item 1 does ni! 


unable to fill his Kn 


(mn) time to ¢ 
FF 


real numb 

ela = eat that 0<y<m, So f, cannot be explicitly com?! 

eet 2 : ven when the Wi are integer, the explicit 6(mn) 
n May not be the most efficient computation. 


Th 
to todcan be 


Unit - 447 
14. Write the recursive, equation for O/1 Knapsack Problem b 
principles of optimality. Explain its execution Strategy, ased on 


the 
(R.GRY, May 2019) 


Ans. Refer to Q.11, Q.13 and Prob.2. 


O15. Explain multistage graphs. (R.GPY., June 2016) 


Or 
Write a short note on multistage graphs, (R.GRY, May 201 8) 
Or 


What is multistage graph ? (R.GRY, May 2019) 


Ans. The multistage graph problem is to find a minimum-cost from 
source to sink, i.e., target. 

A multistage graph is a directed graph with multiple stages. If we denote 
agraph G=(V, E) in which the vertices are partitioned into k > 2 disjoint sets, 
V;, Isisk. 

So that, if there is an edge <u, v> from u to vin E, theu € Vjand ve vj,1, 
for some i, 1 <i<k. And sets V, and V,, are such that IVi]= [VJ = 1. 

In multistage graph, we try to find a minimum-cost path from source to sink. 

If we consider s a vertex in V, and t a vertex in V,. The vertex s is 
supposed as the source and vertex t as sink. The cost of a path from s to t is 
the sum of the costs of the edges on the path. 


Here, each set V; defines a stage in the graph. Every path starts from 
Stage 1 goes to Stage 2 then to stage 3 and so on, because of constraints on E. 


A multistage graph is shown in fig. 3.2. 


Fig. 3.2 Five Stage Graph ; 
8. 3.2, minimum cost s to t path is indicated by dashed line. This 


Th fj 


used for solving many problems such as allocating some resources 
Biv ig many prol : 
“ number of projects with the intend to find the maximum profit. 


of Algorithm (B.E., lV-Sem.) 

‘ a raph problem ?Discuss its solution i‘ 
Q.16. What is eos Give a suitable algorithm ana 

amic programming (R.GPRV., June 2007, 2013, Ded p! 


Or 


_ ith mple. (R.GP. 
Explain multistage graph problem with example. (R.GRY, June 2) 
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dyn s 
computing time. 


js ith the help of suitabl, “ 
multistage graph problem wit le algoriy 

Define (R.GPV, June m4 

‘Ans. Multistage Graph Problem — Refer to Q.15. 

Solution Based on Dynamic Programming = A dynamic programy: 
formulation for a k-stage graph problem is obtained by first noticing 
every source(s) to target (t) path is the result ofa sequence of k-2 Aecisa) 
The ith decision takes into consideration which vertex in V;,1,i<i<k2j 
be on the path. Here principle of optimality holds. Let P (i, j) be a mini 
cost path from vertex j in V; to vertex t. Let cost (i, j) be the cost of this 
Then, using forward approach, we get 

cost (i, j) = Min {c(j,/) + cost(i+1,/)} 
Teint 


GDeE ! 
As, cost (k— 1, j) = Gj, t) if Gj, t) € E and cost (k — 1, j) = if, t)e 
The above equation (i) can be solved for cost (1, s) by first comp 
cost (k —2, j) for all j € Vj_2, then cost (k — 3, j) for all j © Vy_3, ands 
and finally cost (1, s). Now we try this method to solve the graph of fig! 
we obtain a 
cost (3, 6)= min {6 + cost (4, 9), 5 +€ost (4, 10)} =7 
cost (3, 7) = min {4 + cost (4, 9), 3 + cost (4, 10)} =5 
cost (3, 8)=7 
cost (2, 2)= min {4+ cost (3, 6), 2+ cost (3, 7), 1 +cost G8) 
cost (2, 3)=9 
cost (2, 4)= 18 
cost (2, 5) = 15 
cost (1, 1)= min {9 + cost (2, 2), 7 + cost (2, 3)s 
3 + cost (2, 4), 2 + cost (2, 5)} 


= 16 
” Notice that in calculation of cost (2, 2) we have reused the values 
ot ote (3, 7) and cost (3, 8) and so avoided their recomputstiey i 
ee Cost s to t path has a cost of 16: This path can be found a i! 
rd the decision made at each state (vertex). Let d (i, j) be e 
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is a node minimizes c (j, /) + cost (j 
fig. 3.2 we obtain SG 1D. Now for graph 

d (3, 6) = 10;4 (3, 7)= 10; d(3, 8)=10- 

d (2,2) =73d(2,3)=6;d(2,4)=8; 

d (2,5) =8;d(1, 1)=2 

To write an algorithm fora general k-stage graph, we i 
F 5 of iph, We impose an i 
on the vertices in V. We require that then vertices in V are jee ee 
n, Indices are assigned in order of stages. Here first S, is assigned index 1 
then vertices in V2 are assigned indices, then vertices from V3, and so on, 
Vertex t has index n. Thus, indices assigned to vertices in Vi+1 are bigger dian 
those assigned to vertices in Vj. Thus due to indexing scheme, cost and d can 
be computed in the order n—1,n—2,...., 1. The first subscript in cost, p and 
d only identifies the stage number and is omitted in the algorithm 3.2. The 
resulting algorithm, in pseudocode, is F Graph. 
Algorithm 3.2 Multistage Graph Pseudocode Corresponding to the 

Forward Approach 
Algorithm F Graph (G, K, n, p) 
// The input is a k-stage graph G = (V, E) with n vertices, 
// indexed in order of stages. E is a set of edges and 
// c[i, j] is the cost of <i, j>, p [i : k] is a minimum-cost path. 


{ 


(where / i 
shown in 


cost [n] : = 0.0; 

for j:=n-—1 to 1 step—1do 

{// Compute cost [j]. 

Let r be a vertex such that <j, > is an edge 
of G and ¢ [j, r] + cost [r] is minimum ; 
cost [j] : = c [j, r] + cost [r] 

d{jJ:=r; 


apse ie as 
For Pa Sif ee 


12.5 
» // Find a minimum-cost path 
> P[l]:=1;p[kj:=n; 
- for j:=2tok-—1dop{jJ:=4Pi-; 
17. } 
The multista; 
ge graph problem 
\PPtoach. Let bp (i, j) be a minimul 
i Let b cost (i,j) be the cost of bp (i 


can also be solved by using the backward 
m-cost path from vertex s to a vertex j in 
j). From the backward approach, we get 
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tbeos G-LD +e} 4 


b cost (i, j) ive 


Gper 1, j> € Eand b cost (2, j) =co if. 
. + (2, =e (i) fees a eS 
b eee computed using equation (i) by first computing bere 
= 3, then for i =4 and so on. For the previous graph shown in fig. 3.2, weg 
" p cost (3, 6) = min {b cost (2, 2) + ¢ (2, 6), B cost (2, 3) +eG,g 
=min (9+4,7+2}=9 


b cost (3, 7) = 11 
b cost (3, 8) = 10 
b cost (4, 9) =15 
b cost (4, 10)= 14 
b cost (4, 11)= 16 
b cost (5, 12)= 16 
Time Complexity — FGraph algorithms complexity analysis is fie 
straight forward. If G is represented by its adjacency lists, then r in line) 
algorithm 3.2 can be found in time proportional to the degree of ver: 
Thus, if G has |E| edges, then the time for the for loop of line 7 is © (\V|+f 
The time for the for loop of line 16 is @(k). Thus, the total time is ams 


0.17. What is reliability design problem ? Explain. 
(R.GP.V., Dec. 2009, 
t 


Or J 
Explain how a reliability design can be obtained using 4) 
programming. (R.GP.V., Dec. 
Or 
How reliability of a system is calculated ? (R.GP¥,, June 
Or 
Write short note on reliability design. (R.GP.V., Dec. 2011, June 
Or ‘ 
What is the concept of reliability design in dynamic programnit 
(R.GP.V., Det 4 
Exp lai aa Or 
lain reliability design problem with suitable example. 
(R.GPV, ved 


Ais ere ; yystem 
Pa oc mooie design, the problem is to design 4 S) 
of several devices connected in series as shown in fig- u 


—— - 


Fig. 3. i F 
‘8: 3.3 n Devices D;, 1 Si <n, Connected in Series 
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If we imagine Fr as the reliability of a device (i.e. probability that it 
p, will work properly). tiie 
"phen the reliability of the function can be given as II, 
. 1 
If, = 0-99 and n= 10 that n devices are set in a series, 1 <i < 10, then 
reliability of whole system Tl, can be given as — 
Tl, = 0.904 
So, if we duplicate the devices at each stage then reliability of the system 
can be increased. 
Say, multiple copies of same device type are connected in parallel through 
the use of switching circuits. This is shown in fig. 3.4. 


Stage 1 Stage 2 Stage 3 Stagen 


Dy 
Dy peo -nnnee 


D. 
3 
D3 


Fig, 3.4 Multiple Devices Connected in Parallel in Each Stage 

Here, switching circuit determines which devices in any given group are 
functioning properly. Then they make use of such devices at each stage, that 
result is increase in reliability at each stage. If at each stage, there are m, 
similar type of devices D,, then the probability that all m; have a malfunction is 
(1—1,)™i, which is very very less. 

And reliability of stage i becomes (1— (1-1) ). Thus ifr; = 0.99 and 
m; = 2, then the stage reliability becomes 0.9999 which is almost equal to 1. 
Which is much better than that of previous case or we can say the reliability is 
little less than 1 — (1-1,)™ because of less reliability of switching circuits. 

In reliability design, we try to use device duplication to maximize reliability. 
But this maximization should be considered along with cost. 

Let c is the maximum allowable cost and ¢; be the cost o! 
device j, 


Then the maximization problem can be given as follows — 
Maximize [Tj<i<n 6; (m) 
Subject to Dein <e 


Isisn 


f each unit of 


m; 2 1 and integer 1 <i <n. 


1 it , IV-Sem.) 
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Here, 6; (m;) denotes the reliability of stage 1. 
2 Vi 


The reliability of system can be given as — 


Ty <isn 4 (m)). 

If we increase, number i 
then also only cost will increase but relial 

0.18. Briefly explain the concept of dynamic programming, p 


iabilit is be obtained using dynamic programm; 
how a reliability design can (RGPY. aa : 


of devices at any stage beyond the Certain jj 
bility could not increase, | 


Ans, Refer to Q.1 and Q.17. 
0.19. What is all-pair shortest path problem ? 
Or 
it m to find all-pair shortest path. Derive its comp! 

Write an algorithm to fi Chany, na a 

Ans. Let G = (V, E) be a directed graph withn vertices. Let Cost bea 
adjacency matrix for G such that cost (i, i) =0, 1 sis n, Now cost (ij) ist 
length (or cost) of edge <i, j> if <i, j> ¢ E(G) and cost (i, j) = 00 ifi #j and: 
j> ¢ E(G). The all-pairs shortest-path problem is to find a matrix Assuchi | 
A (i,j) is the length of a shortest path from i to j. The matrix A can be ob 
by solving or calculating n single-source problems using the algorithm 
shortest paths shown below — 

Algorithm 3.3 Function to Compute Lengths of Shortest Paths 
Algorithm AllPaths (cost, A, n) ? 
// cost [1 :n, 1 : n] is the cost adjacency matrix of a graph wil 
//n vertices ; A [i, j] is the cost of a shortest path from vertex 
// i to vertex j. cost [i, i] = 0.0, for 1 <i<n. 


fori:=1tondo 
for j:=1tondo 
A[i, j] : = cost [i, j] ; / Copy cost into A 
tondo 
=1tondo 
for j:=1tondo a 
Afi, j] :=min (A [i, j], Ali, kK) + ALK): 


fork: = 
for 


COIDAHABwWRHS 


=o 


12 } 


Complexity — Here each applicatj iven in algo” 
& ‘pplication of the procedure giv! rr 
3.4 needs O(n?) time, Thus the matrix A can be obtained in 0(0°) ti™® 


9.20. Define all-pai i ution 
“Pairs shortest path problem. Discuss $0! 
Problem based on dynamic programming. (R.GP. a Dee 
Ans. Refer to Q.19. . 
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Here the main restriction is that G have no cycles with nepati 
Notice that if we allow G to contain a cycle of negative fears oo. 
shortest path between any ie vertices on this cycle has length — o, 

Let us consider a shortest ito j path in Gi+j. This Path starts at vertex i and 
goes through some intermediate vertices (Possibly none) and terminates at vertex 
|, Here we assume that this path contains no cycles for if there is a cycle, then this 
can be deleted without increasing the path length (no cycles has negative length). 
Now if k is an intermediate vertex on this shortest path, then the subpaths from i 
to k and from k to j must be shortest paths from i to k and k to j, respectively, 
Otherwise, the i to j path is not of minimum length. Hence the Principle of optimality 
holds. This indicates us to use dynamic Programming approach. 

If k is the intermediate vertex with highest index, then the ito k path isa 
shortest i to k path in G going through no vertex with index greater than k-1, 
Here similarly the k to j path is a shortest k to j path in G going through no 
vertex of index greater than k-1. We can regard the construction of a shortest 
i to j path as first requiring a decision as to which is the highest indexed 
intermediate vertex k. After this decision has been made, we have to determine 
two shortest paths, one from i to k and the other from k to j. Neither of these 
may go through a vertex with index greater than k-1. Here AK(i, j) is used to 
tepresent the length of a shortest path from i to j going through no vertex of 
index greater than k, we get 

A (i, j) = min {min {A‘! (i, k) + AK! (k, j)}, cost (i, j)} 
l<k<n 

Clearly, A° (i, j) = cost (i, j), ii <n, 1 <j <n.A recurrence for AK (i, j) 
is obtained by using an argument similar to that used before. A shortest path 
from i to j going through no vertex higher than k either goes through vertex k 
Orit does not. If it does, AK (i, j) = A‘! (i, k) + AX! (k, j). If it does not, then 
ho intermediate vertex has index greater than k-1. Hence AK (i, j) = A‘ (i,j). 
Combining this we obtain. 

AK (i, j) = min (AK (,), AG) +A (Kj), K2 1 

>, Example — Fig. 3.5 shows a digraph with its matrix A°, For this graph 
Ad, 3)#min {Al a, 3), Al (1,2)+A! (2, 3) =2. Here instead of seeing that 
A* (1, 3) =~ co. The length of the path. 
1:2) A, 2 Dinnsts Lys 


<1 
o1l®@ 
1 -2 0 1 
1 oo 0 
Fig. 3.5 Graph with Negative Cycle 


Can be made arbitrarily small. This is due to the presence of cycle 1 2 1 which 
88 a length of — 1. 


it \V-Sem.) 
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Q.21. Explain Floyd-Warshall algorithm with the help of an a 


RGRY, Dee 


Or ' 

it ith suitable example, 

; . hall algorithm wit! 
Explain Floyd-Wars (RGPY, June a, 
Or 4 
B 4 hall algorithm, What is its running time ? 
carey ire (RGRY, Dec. 201, », 
Or | 
it Ive all-pair shortest path 
ite Floyd-Warshall algorithm to so. Path pro} 

Hele Fey RGR, June 2009, 5 


Also write its complexity. 
Or 


Explain Warshalls algorithm. 
Or 
Discuss Floyd-Warshall algorithm. Write its pseudocode, 
(R.GPV, June 2 


(R.GPK, June my) 


Or 
Explain how to implement Warshall’s algorithm without using ex 
memory for storing elements of the algorithms intermediate matrices, 
(R.GPV., May a 
Or 
Write down the pseudocode for Floyd-Warshall algorithm. Take 
graph and apply this algorithm to find all pair shortest path on it. 
(R.GP.¥., May 
Ans. In the Floyd-Warshall algorithm, we use a different charact : 
of the structure of a shortest path than we used in the matrix-multipl - 
based all pairs algorithms. The algorithm considers the intermediate 
ofa shortest path, where an intermediate vertex of a simple path p= “tr 
v;> is any vertex of p other than v, or v,, that is, any vertex in the se 
V;~1}- The Floyd-Warshall algorithm is based on the fol 
observation, Suppose the vertices of G be V = {1, 2, ....., n}; and fe 
» sy k} of vertices for some k. For any pair of vertices i) 
from i to j whose intermediate vertices are all dra¥® 


(1, 2, 0.5 kp, 
Floyd-Warshal 


it! Vesaiesta’ a 
Hane mee with all intermediate vertices in the set {1, 2s" 
Let d*) be the wei he 
F ij Weight of a shi to verte 
intermediate lortest path from vertex i 


F . Unit - i 425 
rtex j with no intermediate vertex numbered higher ¢ 


— ‘ han 
i esi diate vertices at all. It thus has at most one edge, and hence os 
i recursive definition is given by “ 
w_)*3 ke, 
di = 4 ninla(K-D. g(K-D a a(k-1)) 
a ~ |min(ah-, af +6 ») itk>1 


Floyd-Warshall (W) algorithm 
1 n«rows [W] 

2 DOW 

3 fork<Il1ton 

4 do fori<1ton 
5 do forj = 1 ton 

fe min(aft-?, a9 + 4(t-D) 

7 return D®™ 

The running time of the Floyd-Warshall algorithm is determined by the 


triply nested for loops of lines 3 — 6, Each execution of line 6 takes O(1) time. 
Thus the algorithm runs in time O(n3). 


In the Floyd-Warshall algorithm, there are many ways for constructing 
shortest paths. One way is to compute the matrix D of shortest path weights 
and then construct the predecessor matrix x from the D matrix. This method 
can be implemented to run in O(n}) time. Given the predecessor matrix 7, the 
PRINT-ALL-PAIRS-SHORTEST-PATH procedure can be used to print the 
vertices on a given shortest path. We can compute the predecessor matrix 
online just as the Floyd-Warshall algorithm computes the matrices D). 
Specifically, we compute a sequence of matrices 2, (, ..... x, where 
a 2 and nf is defined to be the predecessor of vertex j on a shortest path 

™ Vertex i with all intermediate vertices in the set {1, 2, 
We ©an give a recursive formulation of nf), When k 
1to j has no intermediate vertices at all. Thus 


NIL 
0) 
“p-{ ; 


Formally, for k21 


from 


if i= jor Wj = 
if i# jand wi <© 


nD gat) <a) +a 
no) 1 9 7 ei (k-1) 
BO |e ita oar? +a 


Example — Refer to Prob.9. 
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t is LCS problem ? Write an algorithm to Solve Ig 
using dynamic programming @pproach, 
RGBY, Deo, uh 


uence X of symbols, a subs, ue 
i 
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0.22. Whai 
common sequence problem 


'S Problem — Given a seq| y 
Xis air be any contiguous portion of X. es oe ifx= mf mi 
Xqy X5y Xgy Xg and Xy, Xz, X3 are subsequences Co) : - Given two sequen?) 
‘ad y, present an algorithm that will identify the longest subsequence 
common to X and Y. This problem is known as the longest can 


subsequence problem. 


element of the LCS. The elements of the LCS are encountered in reverse 
by this method. The following recursive procedure prints out an LCS of 
and Y in the proper, forward order. The initial invocation is PRINT-LCS (j 
length [X], length [Y]). = 
PRINT-LCS (b, X, i, j) 
1 ifi=Oorj=0 
then return 
ifb [i,jJ="“%” * 
then PRINT-LCS (b, X, i— 1, j — 1) 
print x; 
else if b [i, j] = “tT” . | 
then PRINT-LCS (b, X, i—1, j) 
- else PRINT-LCS (b, X, i, j — 1) 


NUMERICAL PROBLEMS 


Prob.1. Solve the following instance of 0/1 Knapsack problen 8} 


dynamic algorithm. 
Item 2 3 4 
Weight To | 3 
Value | $40 | $42 | $25 | $12 | 


The capacity of Knapsack m is 10. (R.GPY, Det 
Sol. We have n = 4 

m=10 a 

(i Yas Vs Va) = (40, 42, 25, 12) Be 

Mt Was Wa, Wa) = (4, 7, 5, 3) ‘ 


SI NDAAwWH 
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s° = {(0, 0)} S? = {(40, 4)) 
S!{(0, 0), (40, 4)} si = 
1 = {(42, 7), (82, 1 
S* = {(0, 0, (40, 4), 42, 7462, 1p) OY) 
Purging (vj, w;) with w; > m 
S? = {(0, 0), (40, 4), (42, 1) 
S7 = (25, 5), (65, 9), (67, 12), (107, 16)} 
S? = {(0, 0), (40, 4), (42, 7), (25, 5 i 
Purging (v;, w;) with w; > m, (25, 5), (65, 9), (67, 12), (107, 16)} 
S? = {(0, 0), (40, 4), (42, 7), (25, 5), (65, 9)} 
Dominance rule i.e. ’ 
If vj S vj; and w; = w, then discard (Vip wi) 
So, applying dominance rule on (40, 4) and (25, 5) we have, 
"$3 = {(0, 0), (40, 4), (42, 7), (65, 9)} 
S} = {(12, 3), (52, 7), (54, 10), (77, 12)} 
s! ~ {(0, 0), (12, 3), (40, 4), (42, 7), (52, 7), (54, 10), (65, 9), (77, 12} 
Purging (vj, Wj) with Wj > m and applying dominance rule, we have 
S*= {(0, 0), (12, 3), (40, 4), (52, 7), (65, 9)} 


5% ais the maximum profit = 65 and the value of x ie. (xy. x3) XX) 
» 9, 1, 0) *, 


Prob.2. Define how Knapsack problem is solved by using dynamic 4 
Programming approach. Consider — g.° 


n = 3, (Wy Wo, Wy) = (2, 3, 3) af 
1p P» p3) = (1, 2, 4) and m = 6, find optimal solution for the given data. 
(R.GP.V., Dec. 2008, 2009, June 2010, 2011, Dec. 2015) 
Sol. Solution of Knapsack Problem — Refer to Q.11. 3 
Problem—Given n= 3, (Wy, W2, W3) = (2, 3, 3) 
(1, P2, p3)= (1, 2, 4) and m= 6 
For these data we have 

S'= (©, 0); 5° = (C1, 2)} 
S'= {@, 0), (1, 2)}; S' = (2, 9. @. 9} B 
¥ = (0, 0), (1, 2), (2, 3), (3, 5)}s Si? = {(4,3), (S, 5), (6, 6), (7, 8)} 
S? = £€, 0), (1,2), (4, 3), (5, 5), (6, 6), (7, 8)} 


domi. © Pair (3, 5) and (2, 3) has been eliminated from S* as a result of 
minance rule, 


of Algorithm (B.E., 1V-Sem-) , 
Init - Ill 129 
i iW) with > ind optimal solution for 0/1 Ky 
Purging (5 Wg), (1s 2h Cs 3h So 53> Gs OD prot Ligh grmemnemens of ack rao ny 
a al is given by the tuple (6, 6) in §3, Py a ed , = 30, 
With m = 6, the value of ,(6) eri The pair (6, 6) came from 4, —e May/June 2006, June 2014) 
y 
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t set X3 i 
6, 6) € S? and 60, We MIE $2. Since (2, 3 s! . F 
a ee ae $ a pes ba ae — P23 - ah 0) a Find the optimal sare ey igparseck problem (Wy We, Wy, Wy) = 
= pC hee ¢ ital ecole » = (2, 5, 8, I) and w = 30, , 
ae aa 0) u $0, we obtain x, = 0. Hence an optimal Solution (10, a », in = Px P. l) and w = 30. (R.GPY, Nov. 2018) 
i 5 ‘een = 
Xp, %3) = 0, 1, D- a eet 
Prob.3. Consider the Knapsack instance with ie objects and a cape (Pjs Po» Pav Pa) = 2 5, 8, 1) 
m= II, profits p = (5, 4, 7 2s = ot _— n= es ~ Be Ke Sob (w,, w,4igw,) Mtagals, 6, 9) 
a Oe MN 50 = (0, 0)}3,80 = (2,10) 
wee ST s! = {(0, 0), (2, 109}; s! = {(S, 15) (7, 25)) 
= $2 = {(0, 0) (2, 10) (5, 15) (7, 25)} 
(Py, Pa» P3: Par Ps) = (5, 4, 7, 25 3) 
(yp Wap Way Way Ws) = C4 3, 6, 2, 2) 52 = £08, 6) (10, 16) (13, 21) (15, 3) 
So, by using dynamic programming $3 = {(0, 0) (2, 10) (5, 15) (7, 25) (8, 6) (10, 16) (13, 21) (15, 31)} 
8° = {(0, 0)}; s? = {(5, 4)} Using dominance rules, we have 
$3 = {(0, 0) (8, 6) (10, 16) (13, 21) (15, 31 
S! = (0, 0), (5, 4}; s} = (4,3), 7) NRE ).00; 26) C8, 20.05, 2} 
S? = {(0, 0), (4, 3), (5, 4), (9, 7} $} = {(1, 9) (9, 15) (11, 25) (14, 30) (16, 40)} 
ef.t12. 105001, 9): St= {(0, 0) (8, 6) (1, 9) (9, 15) (11, 25) (14, 30) (16, 40)} 
S? = {(7, 6), (12, 10), (11, 9), (16, 13)} Wb (5) with w,> m 


$3 = {(0, 0), (4, 3), (5, 4), (7, 6), (9 7), (12, 10), (11, 9), (16 
Purging ie a : “ m ciicanine. ee a {(0, 0) (8, 6) (1, 9) (9, 15) (11, 25) (14, 30)} 
S? = {(0, 0), (4, 3), (5, 4), (7, 6)s (9s 7). (125 10), 1 9} | uy With m = 30 the value of fy (30) is given by the tuple (14,30) in $4. The 
7 12)} luple (14, 30) ¢ S3 and so we must set x4 = 1. The pair (14, 30) came from 
Sj = {(2, 2), (6, 5), (7, 6), (9, 8), (11, 9), (13, 11), (14, the pair (14 — Pp» 30 — w,) = (13, 21) € S3, Since (13, 21) € S?, we can set 
S*= {(0, 0), (2, 2), (4, 3), (5, 4), (6, 5), (7, 6)o (7, 5, uh 13 = 1. But it came from the (13 — pp-is 21 — Wy-1) = (5, 15) € S? since 
: (11, 9); (11, 9), (425/103, (13, 11), (44 6,15) e S!. We can set xy = 1. But (6°15) came fom (5 ~ Py-> 15~p.2) 
___ Purging (pj, w;) with w; > m and applying dominance rule = (0, 0). Hence (0, 0) € SI, since (0, 0) ¢ S° then we obtain x; = 0. 
ive., ai Py and w; > w,, then remove (Pj, Wj) lence an optimal solution is (x), X2, X3» X4) = (0, 1, 1, 1). 
Prob.S. Find a minimum cost path from ‘s’ to ‘t’ in multistage graph 


_ 9) si 
{(0, 0), (2, 2), , 3), G, 4), (6, 5), (7, 6), ay g iN *e dynamic programming 


Si = {G,2), 6 4), (7, 5), (, 6), (9, 7), (10, 8), (12, mu 
(15, 12), 
Applying dominance tule one purging (10, § 


S = {(0, 0), (3, 2), (4, 3), (6, 4), (7, 5), (8, 6), (9 1), fi 
(12, 9) 


, 
zy 


Hence, the soluti 9 
can be found ‘5 ti of 0/1 Knapsack is 14 profit on total weigh! if 
ue of (X), x2, x5, X4, Xs) =(1, 1, 0, 1, 1) or” 


gorithm (B.E., 1v-Sem.) 
i mming — A dynamic 

ed on Dynamuc Progra n cy 
eee graph problem is obtained by first notcng 
formulation for a ne pelt er 


‘) path is the res! te 
“* ie ie See cost path from vertex j in V, to y, 


Sf this path. Then, using forward approach, 
cost (i, j) be the ei ) ls min {c(j, ) + cost (i + 1, D} 
leVi+1 


G, D €E 
CG, t) if G, ) € E and cost (k — 1,j) =citgy 
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i 
wep 


As, cost (k— 1, j) = f : 
We first compute cost (k — 2, j) for all jEV,_ > 
cost (3, 4) = min {1 + cost (4, 7), 4 + cost 4, 8) 


= min {8,7} =7 
cost (3, 5) =min {6 + cost (4, 7), 2 + cost (4, 8)} =/ 
cost (3, 6) =min {6 + cost (4, 7), 2 + cost (4, 8)} =) 
cost (2, 2) = min {3 + cost (3, 4), 3 + cost (3, 6)} =| 
cost (2, 3) = 10 
cost (1, 1) = min {5 + cost (2, 2), 2 + cost (2, 3)} 
= min {5 + 8, 2 + 10} = 12. 
Notice that in calculation of cost (2, 2) we have reused the 
(3, 4) and (3, 6) and avoided their computation. Hence minimum cos! 
path has a cost of 16. This path can be found easily if we record the ds: 
made at each state. The minimum path from s to t is as — 
Oo 2 @ 5 © 2 3 Or 
Cost of Path = 12 
Prob.6. Find a minimum cost path from ‘s’ to ‘t’ in multistegt 
using dynamic programming — 


Sol. Similar as Prob.5. 


problem using both forward and backward 
reasoning. 


4 forward approach. 


sing dynamic 
u 
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d minimum cost path from ‘s’ to 


‘Vin multista; 
programming. ge graph 


ob. 7. Fin 


(R.GPV, Dec. 2015) 


Fig. 3.8 


Sol. Similar as Prob.5. 
Prob.8 Solve the following multistage 


(R.GR¥., June 2017) 


Sol. (i) Solution using Forward Approach— 
cost (i, j) = min{c(j, J) + cost(i + 1, J} 
Here, j = Current vertex 
i = Groupnumberin which vertexisplaced ;- 1 
c(j, ) = Weight of path going from j to / 
/ = Next vertex which is connected to j. 
So, in forward approach we start from 
Sink i.e., vertex 6 
We know that sink always have cost = 0 in 


So, cost(4, 6)=0 
Now D 
cost (3, 4) = min {c(4, 6) + cost(4, 6)} 
= min{6} 
=6 
cost (3, 5)=2 
— st (3, 5) = 2 


. 4 Joon, 4 C(2, 5) + cost(3, 5)} 
446,242} 
10,4} ~ 


“£ cost (2, 
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cost (2, 3)= min{c(3, 4) + cost(3, 4), C(3, a an 


= min{3 + 6, 1 +2} 
= min {9, 3} 
=3 
cost (1, 1)= min{c(1, 2) + cost(2, 2), C(1, 3) + co 

= min{3 + 4,2 + 3} 
= min{7, 5} 
=5 

Hence, the minimum cost = 5 


and the path will be 
1333576 


(ii) Solution using Backward Approach — 


Formula — 
b cost(i, j) = min{b cost(i — 1, J) + c(i, j)} 
Since _ b cost(2, j) = c(1, j) if<1,j> €E 
So b cost(2, 2) = e(1, 2) =3 
b cost(2, 3) = c(1, 3) =2 


Now 
b cost(3, 4) = min{b cost(2, 2) + c(2, 4), 
b cost (2, 3) + c(3, 4)} 
= min{3 +4, 2 +3} 
= min{7, 5} 
=5 
b cost(3, 5) = min {b cost(2, 2) + (2, 5), 
b cost(2, 3) + (3, 5)} 
min{3 + 2,2 +1} 
=min{5, 3} 
= 
b cost(4, 6) = min{b cost(3, 4) + (4, 6), 
b cost(3, 5) + (5, 6)} 
= mir (5 + 6,3 +2} 
= min{11, 5} 
The minimum path if 
and path will be 1 3 “eae ona 


il} 
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1.9. Find all pair shortest path using Floyd-Warshalt algorithm foi 
r 


ine given graph 


Fig. 3.11 (R.GR¥, June 2011) 


‘Sol. The sequence of matrices D™ and x computed by the Floyd-Warshall 
algorithm for the given graph is computed as follows — 


0 5.0 4 NIL 1 NIL 1 
pMOa|2 9 6 —) ,@_|NIL NIL 2 NIL 
20 0 @ 3 NIL NIL NIL 
o 3.1 0 NIL 4 4 NIL 
0 5 @ 4 NIL | NL 1 
p®_|2 9 6 ©) @M_/NIL NIL 2 NIL 
a 7 0 6 3 | NL 1 
o 310 NIL 4 4 NIL 
0514 NL 1 2 1 F 
p@) =] © 06 @ n@) = NIL NIL 2 NIL 
270 6 3 1 NL 1 
o 3 1 0 NIL 4 4 NIL 
5 ll 4 NIL 1 2 1 
0): 0 6 12} ~@_| 3 NL 2 1 
p=l2706|" “| 3 1 NDI 
33 7 0 3.4 4 NIL ( 
055 4 NL 1 4 i 
(4)_]8 0 6 12] @)_| 3 NIL 
B07 6 lt] 31 NL I 
3310 3 4 4 NIL 


ipad Prob.10. Use the Floyd-Warshall algorithm and, find all pair shortest 
hs for the following adjacency weighted matrix. 


Sol, pi) = 


0 


HABBO NUR 


4 wo 3 

021 

ee 

o20 (RGR, June 201 2 

4 0 3 NIL 1 NIL 1 
21 _ | NIL NIL 2 2 

: 02 au 3 3 NIL NIL 

o 2 0 4 NIL 4 NIL 


ithm (B.E., 1V-Sem.) 
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00 3 @ ‘NIL 
for D) — 0 NIL 1 NIL 
and fos i) Set row 1 as row | of D®. (0) 2 0 oo) | |2 NE NE NIL 
. Jumn | same as column 1 of D™. p%=|0 7 0 1/n=!|NL 3° we 3 
(ii) Set colum d.columns of D\) same as row and Columy Y Gt eet ee 0 4 NIL NIL NIL 
; ii) ST eel Dp. Here column 3 and row 2 will be RY [0 07 3 @ NIL NL 1 oN 
whieh contains i 2 g ; ° xf) wh NIL 1 NIL 
Die i fe es Di)= 2 > 3 NIL 3 
(iv) Fill the other column according to the formula 6 © 9 0 4 NIL 1 NIL 
5 K-1)_ y(k-D (k=1) = 
pb) im min(D{ », vg +Dyj ) fo o 3 w NIL NL 1 NIL 
- 205 @ 2 NIL 1 NIL 
[0 4 wo 3 NIL 1 NL p®?=|9 7 0 1/nm=!2 3 mL 3 
a fe 9 2 Wy e|NIL NIL 2 [6 0 9 0 4 NIL 1 NIL 
De 5. 3) 0 8 33° MLL | 0 10 3 4 
15 2.0 4 1 4 [ Me 3 it 6 
L L N m 20 56 28 2 NL 1 3 
2 4) DW=|9°7 0 1 =| 2 3 NIL 3 
Similarly for D@) and so on upto D‘ ; ls 16 9 0 4 3 1 NL 
[0 4 6 3 NIL 1 2 
fo 10 3 4 NL 3 1 3 
pa=|" ° 4 : nQ) = ae a a 2056 2 NL 1 3 
5 3 i ie D®=|7 7 0 I1/n=| 4 3 NL 3 
[1 5 2 0 L i [6 16 9 0 4 3 1 NL 
fo 4 6 3 NIL 1%! Prob.12. What is dynamic programming ? Applying dynamic 
DG) = 70 2 3 73) = 3 NIL 212 Programming determine a longest common subsequence of <I, 0, 0, I, 0, 
“15 3 0 4 3 3 NIL 1,0, 1> and <0, 1, 0, 1, 1, 0, 1, 1, O>. (R.GPV., Dec. 2011) 
[1 52 0 i ek Or 
a ¥ Fe Determine on LCS of <I, 0, 0, 1, 0, 1, 0,1 >and <0, 1, 0, 1, 1, 0, 1, 1, 0>. 
045 3 SN Mf 1 How dynamic programming can be applied to LCS ? (R.GP.V., Dec. 2012) 
2021 
p®=|5 3 0 4/n=-| 3 3 NL} Sol. Dynamic Programming — Refe to Q.1. 
1520 4 1 4 M ie Longest common subsequence of <1, 0, 0, 1, 0, 1, 0, 1 > and <0, 1, 0, 
On F “ 1,0, 1, 1, 0, > is determined as follows — 
is the required answer, yj 0 1 0 1 1 0 1 1 0 
Prob.11. Using Floyd-Warshall algorithm solve the all pair % 0 9 9 0 0 0 o oO oO 0 
path problem for the graph. Where weight matrix is given below ‘ 0 To 1 <4 1 1 <1 1 1 a 
0 0 3 w 09 1M @ere 24342 | 
a 2 0 @ w ; : 1 n oT 2 12 tT Fs “4 4 <4 
: 2-70 1 : an : 6 % rr 8 4 4 14 55 
: 6 © w 9 RGR | Logo nF 8 |G ta g 4 15 
Sol: The sequence ix DY Floye” i 2 1 te 3 4 «714 5 5 3 
ato matrix D® and x computed by the 0 2 4 5 16 6 6 616 


ithm for the given graph is computed below — 
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on sequence could be <1, 0, 0, 1,1, O> as in 
ther LCS’, if we choose < instead oth 
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A longest comm 

below (there could be some 0 
efi- 1, i) = oli. J- 1); 

X:<10,> 

¥: <0, 1,0, 1, 1, 0, 1, 

So the LCS is 100110. 


, 0, 1,0, 1,0, 1 > 
-, 1,0, > | 


BACKTRACKING CONCEPT AND ITS EXAMPLES LIKE 8 
QUEEN’S PROBLEM, HAMILTONIAN CYCLE, GRAPH | 
COLORING PROBLEM ETC. i 


Q.1. Explain backtracking. Write an algorithm to estimate the efficiency 
of backtracking. (R.GPV., Dec. 2012) 

Ans. Backtracking is the most general technique to solve many problems 
that deal with searching for a set of solutions or which ask for an optimal 
solution satisfying some constraints. The name backtrack was first coined by 
D.H. Lehmer in the 1950s. 

In many applications of the backtrack method, the desired solution is 
expressible as an n-tuple (x1, Xz, «+++.» Xn)» Where the x; are chosen from some 
finite set S;, Generally the problem to be solved calls for finding one vector 
that maximizes (or minimizes or satisfies) a criterion function P(X, 2» 
X,). Sometimes it seeks all vectors that satisfy P. 

Some of the examples that can be solved by backtracking are — 

(i) Sorting the array of integers in a {1 :n} 

(ii) 8-queens problem 

(iii) 4-queens problem, or in 

(iv) Sum of subsets problem. 
Algorithm — 4.1 Estimating the E 
Algorithm Estimate( ) 

// This algorithm follows a random path 
‘in a state space tree and produces an 
/ estimate of the number of nodes in the tree. 


{ 


generalized way n queens problem 


fficiency of Backtracking 


i:=1;j:=lk:=b 
repeat : 


{ 


PI ANSYN> 


138 Analysis & Design of ‘Algorithm (B.E., 1V-Sem.) 
wesey ALi — 1) 


9. 


A i] : = Choose (V; 
. :" until (false); 
15. } 


0.2. Write recursive backtracking algorithm. 

Ans, Algorithm 4.2 presents a recursive formulation of the backing 
technique. Naturally describing backtracking in this way is essential decay 
is a postorder traversal ofa tree. This recursive version is initially invoke) 
Backtrack (1) ; 

Algorithm 4.2 Recursive Backtracking Algorithm 

i Algorithm Backtrack (k) 
2 / This schema describes the backtracking process using 
3 // recursion. On entering, the first k-1 values. 
4. // x{1], x[2], ..... x[k — 1] of the solution vector. 
5.  // x{1 :n] have been assigned. x[ ] and n are global. 
6 
7. 
8 


for (each x [k] € T (x [1], ....., x [k— 1]) do 


: { 
9. if (By (x[1], x[2], ........ x[k] # 0) then 
10. { : 
ll. if (x [1], x[2], ....... x [K] is a path to an answernt 
12. then write (x [1 : k]); 
: if (k <n) then Backtrack (k +1); 
} 
15, } 
16. } 
The solution vector (X}, X2,-.005%}) is treated as a global array xl! 


X41). Each time x, 
been found. Then the al; 
line 7 is completed, no 


more val i of 
ends. The last unresol lues for x, exist and the current copy 


ved calls now resume: that co! 

se Si Ss, namely, the one 
: oe clements assuming only k-2 ines have been set. 
printed aa ae ‘o be noted is that this algorithm causes all solutt’ 
‘umes that tuples of various sizes may make up 4 solutt 


li 


algorith 
Algori 


backtrackin, 1g. 
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03. Write non-recursive backtracking algorithm, 

ans. AN iterative or non-recursive version of algorithm 4.2 appear in 
m 4.3. 

thm 4.3 General Iterative or Non-recursive Backtracking Meth 
Algorithm Backtrack (k) ve” 
// This schema describes the backtracking process. 

// Allsolutions are generated in x [1 : n] and printed wy. 


: // as soon as they are determined. 

5% f 

6 k:=1; 

1 while (k # 0) do 

8. { 

9. if (there remains an untried x[k] € T (x [1], x[2], ...., 
10. x [k = 1}) and B, (x [1], ....., x[k]) is true) then 
Il. 

12. , X[k] is a path to an answer node) 

13. (x [1 : k); 

14. k:=k+1; // consider the next set 

15. } 

16. else k : = k — 1; // backtrack to the previous set 

17. } 

18. } 


Here point to be noted is that T( ) will yield the set of all possible values 


that can be placed as the first component x, of the solution vector. The 
component x, will take values for which the bounding function B,(x) is true. 
Also notice that how the elements are generated in a depth first manner. The 
variable k is continually incremented and a solution vector is grown until either 
solution is found or no untried value of x;, remains. The algorithm 4.3 must 
Tesume the generation of possible elements for the kth position that have not 
yet been tried when k is decremented, Hence one must develop a procedure 
that generates these values in some order. 


2.4. What is backtracking ? Explain recursive and non-recursive 
(R.GBR¥., Dec. 2011) 


Or 
Explain the concept of backtracking.  (R-GRV, June 2008, 2014) 
(7) 


ir 
Explain back ii ic for designing an algorithm. 
acktracking technique fo re pas V. Dec. 2007, June 2013) 


F Or A 
Explain b ing ii tail. Also write algorithm for recursive 
tracking yea nce (R.GRV., June 2015) 


Ans, Refer to Q.1, Q.2 and Q.3. 
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Q.5. Explain state space tree. (RGRY, June : 

‘Ans. State space tree is useful to develop some terminology i 
tree organizations of solution spaces. Each node in this tree defines et 
state, All paths from the root to other nodes define the state Space g 
problem. Solution states are those problem states S for which the ma 
the root to S defines a tuple in the solution space. Answer states = 
for which the path from the root to S defines a tuple tat 
N of fy 


solution states S t 
member of the set of solutions of the problem. The tree organizatig 
solution space is referred to as the state space tree. 


0.6. Explain 4-queens problem. 
Ans, Similar to n-queens or 8-queens problem, in 4-queens Problemy 


have 4-queens to be placed on a 4 x 4 chessboard, satisfying the consi! 
that no two queen should be in same row, same column, or in same iagy, 


Now according to external constraints the solution space consist «j/ 
4-tuples i.e., S;= {1, 2, 3, 4} and 1 <i < 4, whereas the internal constns: 
have 4! solutions i.e., permuation of 4. 

Fig. 4.1 shows the tree organization of the 4-queens solution space, 


© Ne NOS Ia)S ! 
19999999090090900 


Fig. 4.1 Tree Organization of the 4-queens Solution Space ane 
oan Numbered in Depth First Search) f 
wae shown in fig. 4.1 is called the permutation tree. The a 
one 'y possible values of: x;. Edges from level 1 to level 2 specify 
subtice ant leftmost subtree contains all solutions with x, = 15#8 
ae “i all solutions with X, = 1 and x, = 2, and so on. 
solution space es cm labeled (represented) with the values of %: 
are 4! = 24 “fined by all paths from the root node to a leaf node 
leaf nodes in the tree of above figure. 


Ui 


q 
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Q7. Explain and solve 4-queen’s problem using backtrackir 

ing. 
(R.GPY, June 2010, 

ans. Refer 0 06. , Dec, 2017) 
packtracking method can be applied on 4-queens problem to solve it. In 
this te chnique, as a bounding function, we use the obvious criterion that if 
(Kp X20 0 x;) is the path to the current E-node, then all the children nodes 
with parent-child labelings x; , ; are such that — 

(Xqp Xae veers Xi +) represents a chessboard configuration in which no 
two queens are attacking. 

We start with the root node as the only live node. This time this node 
becomes the E-node and ‘the path is (.). We generate the next child, Suppose 
we are generating the child in ascending order. Thus, node number 2 of fig. 
4.1 is generated and the path is now 1. See fig. 4.2. 


Fig. 4.2 Portion of the Tree of Fig. 4.1 that is Generated During Backtracking 
This means that the queen 1 is placed in first row and in first column as 
shown in fig. 4,3(a). 
ti Now, node 2 becomes the next E node or line node. Further, try next 
wes node that node is 3 having x = 2. ie., queen 2 placed in 2nd 
i ‘umn but if we do this then queen 1 and queen 2 become in same diagonal, 
> node 3 becomes dead here, and we backtrack to node 2 and try next 
Possible Node, i.e., node 8. 


Here, 


i ced in 3rd column as shown in fig. 4.3(b). 
This satis; 


> X2 = 3, i.e., queen 2 is pla maton 
fy all the constraints. So now, node 8 becomes the next live = a 1 
After this we tr i = 2, i.e., queen 3 placed in 2n 
try node 9 having x3 = 4, 6» T” " 
b ‘umn, but by this, queen 2 and queen 3 are in same diagonal. So, this node 
“comes dead. 


sis & Design of Algorithm (B.E., lV-Sem.) 
node 11, with x3 = 4. But in this ean 
queen 2 and queen 3 are in same diagonal resulting node 1] ag g dea’ 
shown in fig. 4.2 indicated by symbol B. . 
We have tried all possible positions for queen 3;.i.., column 1 
but any of positions is not satisfying all the secon shown in f : W 
So, we backtrack to previous live node, i.c., node 2 and try another I 
node, i.e., node 13. 
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We try for next possible 


Fig. 4.3 Solution of 4-queens Problem using Backtracking 
Now, node 13 becomes the new live node with x2 = 4, i.e, queen! 
placed in 4th column as shown in fig. 4.3 (d). 
After this we try next node, i.e., node 14. It becomes next live noderé 
X3 = 2, i.e., queen 3 is placed in 2nd column as shown in fig. 4.3 (d). : 
we go ahead with node 15 as new live node with x4 = 3. But this makes 
3 and queen 4 placed in same diagonal resulting in a dead node 15, at! 
backtrack to node 14, shown in fig. 4.3 (e), and then backtrack to nod 
and try another possible node 16, with X3 =3 but this results in queen? 
queen 3 in same diagonal. So, this node also becomes dead. 
We further backtrack to node 2, but no other node is left to 8) 
2 is also killed and we backtrack to node 1 and try another subtree 
x; =2, Le., queen 1 placed in 2nd column shown in fig. 4.3 (f). ‘e 
__ Again with similar reason, nodes 19 and 24 are killed and we ty™ 
with x) =4, i.e., queen 2 placed in 4th column, shown in fig. 4.3 (). F: 
tty node 30 as next live node with x; =I and finally proceed to node3! 
=3, Le. queen 4 placed in 3rd column, as shown in fig. 4.3 (h)- al 
Here, all the constraints are satisfied, so we have desired result f 
3}, for 4-queens problem, ; 


2.8. What is backtracking ? Fi q een 
5 ? Find to the 4-4 
using backtracking strategy, Dieses noes (R.GPV Det 


Ans, Refer to QI and Q.7. 
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0. 9, What is 8-queens problem ? _ 
“Ans. 8-queens problem is to place eight queens on an 8 x 
at no two “attack”, i.e., so that no two of them are on 
jumn, OF diagonal. Let us number the rows and Columns of 
a gas shown in fig. 4.4. The queens can also be numbered 
an loss of generality assume queen i is to be placed on To 
vei must be on a different row, Therefore, 
roblem can be represented as 8-tuples (, 
on which queen iis placed. The explicit constraints 
for this formulation are s; = {l, 2, 3, 4, 5, 6, 7, 8}, 
1<is8. Therefore, the solution space is made of 
g8, 8 tuples. The implicit constraints for this 
problem are that no two x;'s can be the same and 
no two queens can be on the same diagonal. The 
first of these two constraints specifies that all 
solutions are permutations of the 8-tuple (1, 2, 3, 
4, 5, 6, 7, 8). This realization decreases the size 
of the solution space from 8° tuples to 8! tuples. 
Expressed as an 8-tuple, the solution in fig. 4.4 is 
(4, 6, 8,2, 7, 1, 3, 5). 


8 chessboard 
the same Tow, 
the chessboard 
1 to 8. We can 
W i, since each 
all solutions to the 8-queens 
» Xg), Where x; is the column 


Column —— 
34 


Fig. 4.4 One Solution to 
the 8-queens Problem 


0.10. Explain backtracking. How backtracking algorithm can be used 

to solve 8 queens problem ? (R.GPV, Dec. 2009, 2011, 2013) 
Or 

Explain eight queen’s problem and apply backtracking to solve this 

Problem, (R.GRV., June 2016, Nov. 2018) 
Or 

What is backtracking ? Explain 8 queen’s problem and how can we 

Solve it using backtracking. (R.GRY,, May 2019) 


Ans. Backtracking — Refer to Q.1. 

In8-queens problem we are supposed 
to place g queens on a 8 x 8 chessboard so 
= : One attacks each other. This problem 
ie ai Solved by backtracking. Here, we 

'Scussing a different generalized way 
Solve such problems. 

Any chessboard square is numbered 
dligacce® in two dimension, i.e., - two 
tee ‘tonal matrix a[l:n, 1:n] having 9 

and n columns, as shown in fig. 4.5- 


ag 


Fig. 4.5 Solution of 8-queens 
Problem 
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ix i lement 
f such matrix is that every e oH 
One general property omen left to the lower right has the sa. 


i | that runs from the J 
pen value. For example, consider the queen at a[3,2] from fig, 4sy| 


A 3,2], af4,3], a[5,4], a[6,5), ang 
js this queen are a[3,2], > and g, 
diagonal squares of i of rows ai 
One property that relates them is that differenc ind Columns; 
constant value. ‘ 


i 


ie. 


3-2=1 
4-3=1 
5-4=1 


6—5=1, and so on. 

Similarly, for the elements that run from the upper right to lower y 
have the same row + column values. For example, in fig. 4.5, diagonal lenny 
are af1,8], a[2,7], a[3,6], a[4,5], and so on. 


ie., 1+8=9 
2+7=9 

3+6=9 

and 4+5=9. 


So, we can use above property to determine the result of our probla| 
Say, any queen is diagonally placed to another queen if and onlyif- 
i-j=k-/ 
or i+tj=k+1 
where two queens are placed at positions (i, j) and (k, /). The first equi 
implies — 
j-l=i-k 
and second equation implies 
j -l=k-i 
So, two queens are in same diagonal if 
j-4=li-k,. 
Algorithm for solvingn-queens problem can be given by using ther 
elements are on same diagonal if 
G-4=|i-K a 
Algorithm 4.4 Gives Answer Whether a New Queen can be Pls 
: Kk Row and it" Column 
Algorithm Place(k, i) 
// Returns true if a 
1 jt 


that 


queen can be placed in k'* row and” 
column. Otherwise it returns false. x{] is a 


ee 


4 global array whose first (k— 1) values have been set 
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5. // Abs(r) returns the absolute value ofr. 
6. { 
7 for j = 1 tok—I1do 
5 if ((x[j] = i) // Two in the same column 
9. or (Abs (x{j] — i) = Abs(j — k))) 
10. // or in the same diagonal 
I. then return false; 
12. return frue; 
13. } 


Here, algorithm 4.4 shows whether a queen can be placed in k"" row and 
i column. If it can, then algorithm returns true otherwise returns false. 


Algorithm 4.5 All Solutions to the n-queens Problem 
Algorithm NQueens(k, n) 


1 

2. // Using backtracking, this procedure prints all 
3. // possible placements of n queens on ann x n 
4. // chessboard so that they are nonattacking. 

5. 4 

6. for i:=1tondo 

7 { 

8 if Place(k, i) then 

9 { 

10. x(k] 

ll. if (k = n) then write (x[1 : nj; 
12, else NQueens(k + 1, n); 

13, } 

14, } 

18." 


i it i il Jacements of n queens on an. 
nx ge - ea aioe Tay two of them are attacking 
®ach other, 

a. By applying above algorithm some of the possible walks for 8-queens 
Problem are shown in fig. 4.6. 
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(8,6,4,2,1,1,1) = 1401 (8,6,4,3,2) = 1977 (8,5,3,2,2,1,1,1) = 2329 


Fig. 4.6 Five Walks through the 8-queens Problem 
Plus Estimates of the Tree Size 


Q.11. Explain n-queens problem. (R.GPV., June 201) 


Ans, The n-queens problem is a generalized problem of 8-queens ort’ 
queens problem. Here, we can think that there are n queens to be placed a1 
n X n chessboard. That means, we have a chessboard having n rows anit] 
columns, and n queens are to be placed on this n x n chessboard such thats) 
two queens are in same row or in same column or 
in same diagonal. That is, no two queens ‘attack’ 
each other. 


7 Here, we suppose that queen i is to be placed 5 
in row i, Say, 1 queen will be placed in first row & 
only, but can have any column from 1,2,.... n sO | 

. 


Column — 
123 ettndt 


that satisfy the explicit and implicit constraints (See 
fig. 4.7). 


All solutions to the n-queens problem can” 
therefore be represented as n-tuples (x,, x5, 


Xn) where x; is the column on whi 
toot 4 ich queen i is 


Fig. 4.7 Ann! 


Chessboard 


slice cule ents using this formulation are S;= {1,2,3,--008 a 
bien . es rele, the solution space consists of n" n-tuP! ‘ 
bere tie icit constraints, that no two x;’s can be the same “oh 
= in same row, same column, or in same diagonal. Sol 
e different. So, by above Constraint, our solution space ca be 
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tions are permutations of the n- 
' é enn our solution Space reduoas tte eee abun ‘ei 
Based on above constraints using backtracking technique, we can solve 
our problem. 
0.12. Solve 8-queen’s problem for a feasible Sequence (6, 4, 7, 1). 
(R.GRV, Dec. 2015) 


Position and each queen is 
lace Ist queen at (1, 6), 2nd 


‘Ans. The given sequence represents column 
placed row by row on given column. That is pl 


queen at (2, 4) and so on. 


Action 


Start 
Not Feasible * 5—4=2-1 


Not Feasible " 6-5=3-2 


ALS HHA 


List Ends : Feasible Sequence 
Hence solution to 8-queen’s problem is (6, 4, 7, 1, 3, 5, 2, 8). 


Q.13. Give the definition of Hamiltonian cycle.(R.GP.V., June 2016) 
Ans. Let G = (V, E) be a connected graph with n vertices. A Hamiltonian 
eyele is a round-trip path along n edges of G that visits every vertex once and 
Teturns to its initial or starting position. 
In other words if a Hamiltonian cycle 
begins at some vertex y, € G and the 
vertices of G are visited in the order 
Vis Vos .es+3Vpey, then the edges (vj, 
Viti) are in E, 1<i< n, and the v; are 
different except for v; and Vass, 
Which are equal. Hamiltonian cycle 
Was suggested by Sir William Hamilton. 
wk Fig. 4.8 shows a graph G1 
; ‘ich contains the Hamiltonian cycle 
»2, 8,7, 6, 5, 4, 3, 1. The graph G2 
a Not contain any Hamiltonian cycle. 
8Iven graph contains a Hamiltonian cy¢ 
“t finds all the Hamiltonian cycles in a graph. 
Undirected. Only distinct cycles are output. 


Fig. 4.8 Two Graphs, One 
Containing a Hamiltonian Cycle 


There is no easy way to find whether 
Je. We have backtracking algorithm 
The graph may be directed 


as follows — 


Hamiltonian cycles in a graph. 


backtracking algorithm. 
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miltonian circuit using backtracking methog 


(v) 
als 
04 
0 ©) 
Fig. 4.9 (R.GPV., Dec, my 
amiltonian circuit exists, Which 


©) 
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0.14, Find a Ha 


Ans. Ina given graph more than one H 


©) 


@ @ 
(@) () 


Fig. 4.10 Hamiltonian Cycles 
Q.15. Explain Hamiltonian cycle with suitable example. 


(R.GP.V., Dee, 20!) 
Or 

Write short note on Hamiltonian cycle. (R.GP.V., June 2008, May 201) 
Or 

Define Hamiltonian cycle with example. (R.GBY¥,, Dec. 20 


Ans. Refer to Q.13 and Q.14. 


0.16. What is Hamiltonian cycle ? Write an algorithm to find d 
(R.GP.V., June 2007, Dec. 
June 2010, 2011, 2013, Dee. #1 
Or 
What is Hamiltonian cycle ? Explain how it can be solved usit 
(R.GRV, June 2014, Dec. 2014 1 


that x; represents the i” visi ve 
find how to conipiii beste vertex of the proposed cycle. Now we ha 


already been chosen. If k = 


e set of possible vertices for xj, if Xj, +» %! re) 


times, we require that x, = 1. If 1 <k< 2, 


ea 
ito 


= the vert: ee 
be connected to bo ex x, be the one remaining vertex al 
th , eter? 


22. 
Algorithm 4.7 is used to find all Hamiltonian cyc! 
started by first initializing the adjacency matrix G[l:n, 
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Algorithm 4.6 Generating a Next Vertex 

Algorithm NextValue’(k) 
xf: k~ lis a path of k — 1 distinct vertices, If 
x (i) = Gian ne Nokes has as yet been assigned to x [k]. After 
11 execution, X [k] is assigned to the next highest numbered vertex 
// which does not already appear in x [1 : k~ 1] and is connected by 
ian edge to * [k — 1]. Otherwise x [k] = 0. If k=n, then 
// in addition x [k] is connected to x [1]. 


repeat 


{ 
x[k] : = & [k] + 1) mod (n+1); //Next vertex. 


if (x [k] = 0) then return; 
if (G[x [k — 1], x [k]] # 0) then 
{// Is there an edge ? 
for j : = 1 to k—1 do if (x [j] = x{k}) then break; 
// Check for distinctness 
if (j =k) then // If true, then the vertex is distinct. 
if ((k <n) or ((k =n) and G [x [n], x [1] # 0)) 
then return ; 


} 
} until (false) ; 
} 


les. This algorithm is 
1: n], then setting 


x2: n] to zero and x{1] to 1, and then executing Hamiltonian (2). 


Algorithm 4.7 Finding All Hamiltonian Cycles 


1. Algorithm Hamiltonian (k) ; 
2. // This algorithm uses the recursive formulation of 
3. // backtracking to find all the Hamiltonian cycles 
4. // of a graph. The graph is stored as an adjacency 
5. // matrix G[1 : n, 1 : nJ. All cycles begin at node 1. 
6. 
& repeat ‘ 

. // Generate values for x [k]. 
9. { ere (W); //Assign a legal next value to x[k]. 
10. if (x [k] = 0) then return; 
ur if (c= n) then write (x [1 : "Ds 
oi else Hamiltonian (k + 1); 

° } until (False) ; 

14. } (False) 
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problem is a problem of finding tour with ag 
Itonian cycle. For the simple case of g e i 
Hamiltonian will determine a minimum. 
edge cost is C, the cost of a tour is aa 


Traveling salesman f 
cost. This tour is a Hami 
whose edge costs are similar, 
if a tour exists. If the common 
are n edges ina Hamiltonian cycle. 


Hamiltonian Cycle’s Complexity — We can define hamiltonian = 


as a formal language as — , nial 
HAM-CYCLE = {(G) : G is a hamiltonian graph} 

If we use the reasonable encoding of a graph as its adjacency mat, 
number m of vertices in the graph is awn), where n = {(G)| is the length 
the encoding of G. There are m! possible permutations of the Vertices, ay 
therefore the running time is Q(m!) = a(n!) = a") > Which is Tot Gat) 
for any constant k. 

0.17. Apply and explain the backtracking method to solve the following. 

(i) Hamiltonian circuit problem (ii) Subset-sort problem, 
(R.GP.V, May 241 
Ans. (i) Hamiltonian Circuit Problem — Refer to Q.16. 


(ii) Subset-sort Problem — The subset-sort problem or the subs 
sum problem is used to find the subset of elements which are selected from! 
given set and whose sum adds up to a given number K. Let us considera®’ 
contains non-negative values. It is assumed that the input set is unique (® 
duplicates are presented). Backtracking algorithm for subset sum is used? 
make a systematic consideration of the elements to be selected. 

Let us assume a given set of 4 elements, such as W{1], WI2], wal! 
W(4]. The following tree diagram depicts approach of generating 
sized tuple and is used to design backtracking algorithm. 
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inction call-and a branch 
ntains 4 children. In other 
different branch. The sub- 


The tree shows that the node represents fu 
resents candidate element. The root node co; 
rds, root considers every element of the set as 

wo! Bi respond to the subsets that includes the parent node, The branch: 
each Jevel represent tuple element to be consid ches at 


lered. For example, at level | 
ea weet [1] can take any value of four branches generated, At level 2 of 


Jeft most node, tuple_vector [2] can take any value of three branches generated, 
and so 0n- . 

For example, the left most child of root generates all those subsets that 
include W[1]. Similarly the second child of root generates all those subsets 
that includes W[2] and excludes W[1]. 

Along depth of tree the elements are added and the sum of the elements is 
satisfying explicit constraints and further continue to generate child nodes, 
Whenever the constraints are not met, stop the further generation of subtrees 
of that node and backtrack to previous node to explore the nodes not yet 
explored. In many ways it saves considerable amount of processing time. 


Q.18. Represent the map in the form of planar graph. Apply graph- 


colouring algorithm. 


Fig. 4.12 

si (R.GRV,, May/June 2006) 
Or 

Explain graph coloring problem with example. (R.GBV, Dec. 2010) 
Or 


Explain graph coloring problem. (R.GRY., June 2011, 2015) 


Write a short note on graph coloring. (R.GPY., May 2018) 


9, 
Write short note on graph coloring problem. (RGR ¥,, May 2019) 


Ans. Let G be a graph and m be a positive integer. The graph ae 
Problem is to discover whether the nodes of G can be covered in sucl 


i j t only m colors are used. 
sisae caer pert ar = pei Here notice that ifd is 


'sis also known as M-colorability decision pro . 
"ps of epg onion 
The M-colorability optimication problem deals with 2 as chromatic 
"for Which the graph G can be colored. The integer is kno’ 
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h of fig. 4.12 can be 
h, For example, the grap acs Col 
paceman Dead 3. The color of each node is indicated next a ig 


lors 1, 2 am : it, 
ae olats are needed to color this graph and hence this graph’s chon 


ber is 3. oT F 
num A graph is known to be planar iff it can be drawn in a plane ing 


way that no two edges cross each other. A special case is the 4-color pra a 
for planar graphs. The problem is to color the region in a map in such a 
that no two adjacent regions have the same color. Yet only four colon 
needed, This is a problem for which graphs are very useful because g map 
be easily transformed into a graph. Each region of the map becomes a 4 
and if two regions are adjacent, they are joined by an edge. Fig. 4.13 shovy 
map with five regions and its corresponding graph. This map needs 4 col 
For many years, it is believed that five colors are needed to color any Map by 
later mathematicians with the help of computer proofs that four Colors ap 


sufficient. 


Fig. 4.13 A Map and Its Planar Graph Representation 
Graph coloring problem can also be solved using state space tree, whet 
by applying backtracking method required results can be obtained. 


Here, we have a state space tree wi ight n +18 
abiowata ig ta Pi e with degree m and height f 


H=1 R 
x3=1 © © QO N 
OOO OOO bY bb O bb 50 0 


Fig. 4. 
ig. 4.14 State Space Tree Sor m Coloring (when n = 3 and m f 
Colors are indicated 


size n-tuples x, by integers (1,2,3) and solutions are give? by 2 


Kgs cncere, . . 
2 » X,), Where x; is the color of node i, i ™! 
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es is 1. Similarly, x, = 
re: ly, X) =3 
wm ates h 3 nted by indices 3, > 
In state space tree, each node at level i has m children corresponding to 
the m possible assignments to x;,1 <i <n. Nodes at level n+ 1 are leaf, nodes 
9.19. Design a backtracking for graph coloring problem, 


(R.GPRY, Dec. 2009, 201 2) 


ents that node | is assigned color whose indic: 
. that node 2 is assigned with a color represe 


Or 
Write a pseudo algorithm for graph coloring problem. 
(R.GPY., June 2014, Dec. 2015) 
Ans. For solving the graph coloring problem, we suppose that graph is 
represented by its adjacency matrix G[I:n, I:n], where Gfi, j] = 1 if (, j) is an 
edge of G, and G[i, j] = 0 otherwise. 
The colors are represented by the integers 1, 2, ...., m and the solutions 
are given by the n-tuple (X,, X9,......, X,), Where x; is the color of node i. 
Algorithm for solving this problem is given in algorithm 4.8. 
Algorithm 4.8 Finding all m-colorings of a Graph 
Algorithm mColoring(k) 
// This algorithm was formed using the recursive backtracking 
// schema. The graph is represented by its boolean adjacency 
// matrix G[1 : n,1 : n]. All assignments of 1,2,...,m to the 
// vertices of the graph such that adjacent vertices are 
// assigned distinct integers are printed. k is the index 
// of the next vertex to color. 


{ 


Ser avewen 


repeat 
10. {// Generate all legal assignments for x(k]. 

ll. NextValue(k); // Assign to x[k] a legal color. 

12, if (x[k] = 0) then return; // No new color possible 

13. if (k = n) then // At most m colors have been ; 
14. // used to color the n vertices. 
IS. write (x[I : n)); 
16. else mColoring (k + 1); 
17. ‘ } until (false); 


c Algorithm 4.8 uses recursive backtracking schema. In ts en 
Slots to be assigned are to be determined from the range (0, m), i.€., 


0 7 
wots are available. Now, the assignment of next color Pte pees aes 
(asented by x[k]. This color is determined by Se ie ae a. m) such 
tha, | 88sumes that colors are assigned to k~ Ha 


‘ adjacency matrix have different integers- 
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Algorithm 4.9 Generating a Next Color 


xt Value(k) 
: ne ake 1] have been assigned integer values in 
3, // the range [1, m] such that adjacent vertices have distinct 
4, // integers. A value for x(k] is determined in the range 
5. // 0, mJ. x{k] is assigned the next highest numbered Color 
6. // while maintaining distinctness from the adjacent vertices 
7. I of vertex k. If no such color exists, then x[k] is 0, 
8. { 
9. repeat 
1 a 
ll. x{k] = (x[k] + 1) mod (m + 1); // Next highest color, 
12. if (x[k] = 0) then return; // All colors have been used, 
13. for j = 1 tondo 
14. { // Check if this color is 
1S. // distinct from adjacent colors, 
16. if (G[k, j] # 0) and (x[k] = x{j])) 
17. // If (k, j) is an edge and if adj. 
18. // vertices have the same color. 
19. then break; 
20. } 
21. if (j =n + 1) then return; // New color found 
22. } until (false); // Otherwise try to find another color. 
23. } 


Now, value x(k], ive., the color to be assigned to node k, is determi! 
from the range (0, m), such that no two adjacent nodes have same values 
no such color exists then x[0] is zero, otherwise have_appropriate value. 

After this algorithm we assign the value of x{k] to k'* node, and id 
whether k = n, i.e., whether all the nodes have been assigned proper cal 
not then continue, otherwise stop the processing. 


Total time required by above algorithm is O(nm") including both ala™ 
4.8 and algorithm 4.9, 


is ‘ 4 
2.20. What is graph colouring problem ? Give an algorithn 
colouring of a graph. (RGRY, Dee 7 
Or 
? Give algorithm to solve this, ie 
(R.GBV., Dec. 2011, Jum 


What is raph coloring problem 


Ans. Refer to Q18 and Q.19. 


% Color in 
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ol. Explain graph coloring problem with their complexity, 


RGRK, Dec. 201 
ies Graph Coloring Problem — Refer to Q.18. y 


Complexity — Refer to Q.19. 


0.22. Explain how graph coloring problem can 
space trees with the help of an example, 
g 


Ans. Suppose, we have a graph G = (V, E), shown in fig. 4.15, 


be solved using state 


Fig. 4.15 A Connected Graph 
The graph is a connected graph with 4 nodes, We have to assign each 
node a color such that no two adjacent nodes have the same color. This is 
possible by using atmost 3 colors. For this, a tree can be generated as shown 
in fig. 4.16, showing all possible ways in the problem to be solved. 


Fig. 4.16 All Possible 3 Colorings Tree having 4 Nodes 
Each path to a leaf represents a color using atmost three colors) eae 
nly 12 Solutions exist with exactly three colors. For example in right Ie 
X1 = 3, node 1 is assigned a color index 3 and node 2 is assign 


dex 2, iLe., Xp = 2 and finally x3 =3 then only two possible flocs are 
“© 1 and 2 that can be assigned to node 4. 

So, X4= 1 or x4 = 2. 3 
Similarly, all other subtrees show the possible solutions. 
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MERICAL PROBLEMS 


Prob.1. Colour the following graph “a ict colouring sn 
What is the minimum number of colours req ? 


Fig. 4.17 (R.GPY, June my) 


Sol. Solution of graph using vertex coloring algorithm Which ug) 


backtracking. ; 
First create the adjacency matrix of graph — 
A; Az A3 Ag 
A,fl 1 1 1 
Ajli t 0 1 
M= 
A3/1 0 1 1 
Agjl 1 1 1 


Initially colour of each vertices is 0. 
Now, set the colour of A; = 1 and check weather its adjacent vert 
have same colour to A or not. 
Since M[I, 2]=1 
ie., there is a path between A; and A 
Now check the colour of Ay 
we have A, = 0 # A, not same colour 
Similarly check colour of A; and Ay 
Colour of A; is not same as its adjacent vertices 
So now go to next vertex. 
Set colour of Ay = 1 
According of adjacency matrix 
A; have A; and A, as its adjacent vertex 
And colour of A, = colour of A,=1 
So, we can’t go forward, we have to backtrack 


es Set colour of Ay = 2 and compare its colour with colour o! 
ertex using adjacency matrix. 
Result — 


Now, 


f its at 


no colour same 


Set the A; vertex as colour 1 (i.e., Az = 1) 


ig 


djacency matrix A, ha’ Unit-1V 457 
ing to a mat " 
P According i My nAyel 3 have Ay & Aj as its aidlaosat vention’ 
2 So, backtrack 
Set A3=2 
No, adjacent vertex of A; have colour 2 | 
Now set Ag = 1 


Adjacent vertex of Ay=A,, Ay and A; 
and Ay =Ay=1 have same colour 
So backtrack 
Set Ay = 2 
Adjacent vertex of A4=A,, Ag and A; 
and Az = Ag = Ag =2 
So backtrack 
Set Ay = 3 
Adjacent vertex of Ay = A;, A, and A; 
No adjacent vertex of Ay have colour 3 
There is no vertex left so break. 
Hence solution — Vertex A; = colour 1 
Vertex A = colour 2 
Vertex A; = colour 2 
Vertex Ay = colour 3 
Minimum colour required = 3 


Prob.2. Colour the following graph using a vertex colouring algorithm. 
What is the minimum colours required ? 


Fig. 4.18 


(R.GRV., Nov. 2018) 
Sol. Similar as Prob.1. 


a 
INTRODUCTION TO BRANCH AND BOUND METHOD, 
EXAMPLES OF BRANCH AND BOUND METHOD LIKE = 

TRAVELLING SALESMAN PROBLEM ETC | 


(R.GPV., June 2016) 


2.23. Define branch and bound method. 
Or 
ie 4 , 2014) 
Explain the use of bounding function. (R.GRV., Dec. 2014) 
"8 (R.GPV., Dec. 2017) 
| state space search methods 
before any other live node 


Write short note on branch and bound. 


Ans, The term branch-and-bound refers o a 


feed 
" Which all children of the E-node are generated 
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Two graph search strategies, BFS and De 
fa new node cannot begin co te node oma 
: . red. Both of these generalize to branch, b 
being explo oP pound terminology, a BFS-like state span 
ae eal FIFO search as the list of live nodes is a first-in-first-oyy = 
D-search-like state space search will be called LIFO search as the liste 4 
nodes is a last-in-first-out list. Bounding functions are used to hel 
generation of subtrees that do not contain an answer node. 


0.24. Explain how branch-and-bound method can be used t pel 
any problem. Give example. 


can become the E-node. 
which the exploration 0 


P avoid gy 


Or 
Explain the branch and bound search, Give an example, 
(R.GP.V, Dec, 2M 
Ans, We try to solve 4-queens problem using branch-and-bound techni 
The problem is to place 4 queens on a 4 x 4 chessboard such that no ty 
queens lie in same row, or in same column, or in same diagonal i.e., no ty 
queens can attack to each other. 
This constraint will act as bounding function in our branch-and-bou 
technique. We will use it to kill the subtrees that does not contain an ansig 
node, State space tree of 4 queens problem is shown in fig. 4.19. 


the E node. It is expanded and its-children, nodes 2, 18, 34, an! 


gos 
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ith ie 1 in row 1 and 
ive nodes are 2, 18, 34, and 
then the next E-node is node 2. It 
Benerated, Node 3 is immediately 
queens should attack and if we 


d. These nodes represent a chessboard wit 
1, 2, 3, and 4 respectively. Now the only [i 
nodes generated are in this order, 
: xpanded and nodes 3, 18 and 13 are 
ai a the bounding function that no 
1st queen in row 1 and column 1, and place queen 2 i 

oie queen 1 and 2 result in same diagonal, so node 3 isk ‘diet onae 
N ‘odes 8 and 13 are added to the queue of live nodes, Node 18 becomes te 
next E-node. Now nodes 19, 24 and 29 are generated. Nodes 19 and 24 are 
killed as a result of the bounding function. Node 29 is added to the queue of 
live nodes. Now the E-node is node 34. 

Fig. 4.19 shows the portion of tree that is generated by a branch-and- 
pound search. Nodes that are killed are represented by “B” under them. Numbers 
outside the nodes give the order in which nodes are generated by FIFO branch- 
and-bound. At the time, the answer node i.e. node 13 is reached, the only 
nodes that are live are 38 and 54. But for above problem backtracking is better 
technique than branch-and-bound technique. 


erates 
columns 
50. Jf the 


0.25. Explain how branch and bound method can be used to solve 
any problem. What is least cost search ? (R.GP.V., Dec. 2012) 


Ans. Branch and Bound Method — Refer to Q.24, 


Least Cost Search — In least cost we give preference to an answer 
node with minimum cost. As in both the cases i.e., LIFO and FIFO, selection 
of next E-node is rigid and in a sense blind. It does not give any preference to 
anode that has a very good chance of getting the search to an answer node 
quickly. As in fig. 4.19, when node 30 is generated, it should have become 
obvious to the search algorithm that this node will lead to an answer node in 
one move. However, the requirement of the rigid FIFO rule is the expansion of 
all live nodes generated before node 30 was expanded. : 

The search for an answer node can often be speeded by using an 
“intelligent” ranking function ¢(-) for live nodes. Next E-node is selected 
“cording to this ranking function. If in 4-queen example we use a ranking 

Netion that assigns node 30 a better rank than all other live nodes, then node 
30 will become the E-node following node 29. The remaining live nodes will 
"ever become E nodes since the expansion of ‘node 30 results in the generation 


an answer node (node 31). 
7 i iti tional 
The ideal way to assign ranks is according to the additional computat 
effort (or cost) recaired Sa ceack ‘an answer node from the live node. For any 


Ode ; 
x, this cost could be e x that should be generated 


() The number of nodes in the subtre 


before an- answer node is generated or simply. 
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ten bre th t answer node (i 
. Js the nearest an: le (in the 
ii) The number of leve 5 
i) ube 


° ao cost measure (ii), the cost of a th of = eats Of fig. 4.19. 
31 is four levels from node 1). Similarly the costs of nodes 1g 
noes 35, and 30 and 38 are 3, 2 and 1 respectively. All Temaining node, 
nae 2, 3, and 4 have costs respectively greater than 3, 2, and 1. Usin, 
costs as a basis to select the next E-node, the E-nodes generated are 
2, 34, 50, 19, 24. 32 and 31. It should be noticed that if cost Measure 
used, then the search would always generate the minimum number of 
every branch-and-bound type algorithm must generate. If the cost 
used is (ii), then the only nodes to become E-nodes are the nodes on the 
from the root to the nearest answer node. The major difficulty with yg, 
either of these ideal cost functions is that computing the cost ofa node g 
involves a search of the subtree x for an answer node. Thus, by the time, 
cost of a node is found, that subtree has been searched and there is no needy 
explore x again. This is the reason why search algorithms usually rank nods 


only on the basis of an estimate &(-) of their cost. 


(i 


So, ranking function can be given as — 
&(x) = f(h@x)) + BC) 

Here, h(x) is the cost of reaching x from the root and f() isa 
nondecreasing function and §(x) be an estimate of the additional effort neste! 
to reach an answer node from x. 

A search strategy that uses a cost function é(x) = f(h(x)) + (x), to sek 
the next E-node, would always choose for its next E-node a live node with las 
&(.). Hence, such a strategy is called an LC-search (Least-cost-search). 

BFS and D-search are special cases of LC-search. If we use 80)! 
and f(h@)) = 0 level of node x, then a LC-search generates nodes byl 
This is same as in BFS, if f(h(x))=0 and &(x) > &(y) whenever y isa! 
of x, then the search is essentially a D-search. 


An LC-search coupled with bounding functions is called an LC bas? 
and-bound search. 


2.26. Explain how to solve sum of subset problem ? 0H 

(R.GPV., Dee 

ae computer science, the subset sum problem is one ofthe! is 

y aes complexity theory. The problem is given a set of intege™", 
ipty subset whose sum is zero ? For example, given the set WV 


~2, 5, 8}, the answer i 
2 ris to 
problem is Necoinpleie because the subset (—3, -2, 5} sums 
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27. Explain travelling salesperson problem. (R.GBY, Dec. 2008) 
In the travelling-salesperson problem, we are oj : 
Ans. ee: re given a complete 
jected graph G=(V, E) that has a nonnegative Integer cost ¢(u, v) associated 
h edge (u, v) € E and we must find a tour of G with minimum cost. 
Let C(A) denotes the total cost of the edges in the.subset A c E, ; 


C(A) = >. c(u,v) 
(uv)eA 

practically, it is always cheapest to go directly from a place u to a place w, 
ing by way 0 f any intermediate stop v can’t be less expensive. Or say, cutting 
out an intermediate stop never increases the cost. This can be formalized that 
the cost function c satisfies the triangle inequality, if for all vertices u, v, w eV, 

e(u,w) < ¢(u,v) + c(v,w) 

This triangle inequality is natural one, and in many applications it is 
automatically satisfied. In this problem, our tour starts from an initial state and 
completes after returning to original state passing through all intermediate states. 

If the graph has n vertices, i-e., |V|=n, then the solution space S is given 
byS={1, 7, 1, :7 is a permutation of (2, 3, ....., m)}. 

Then |S| = (n — 1)! 

The size of S can be reduced by restricting S so that (1, ij,..., ig iy — 15 
I) eS iff (i;, i; + 1) €B, O<j <n—I1, andig=i,=1. 

State space tree for this problem, for n = 4 and initial and final states | is 
shown in fig. 4.20. 


Fig. 4.20 State Space Tree for Travelling Salesperson 
Problem with n = 4 and ig=ty= 


2.28. Solve travelling salesman problem by using branch and bound 


is (R.GRK, Dec. 2010) 


nique with example. 


How travelling salesperson, problem 


or 
Whatis Sa 
© be son mich and bound techie" GV, Dec. 2011, June 2013) 


n 
be solved using this technique ? 
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Or 


i lesperson problem be solved ? (R.G. 
Hai oi ae SSP Or ss ine, 


Apply the branch and bound algorithms to solve the travelling Sa 
problem. Use suitable graph. (R.GPY, May 
‘Ans, Branch and Bound Technique — Refer to Q.23, 'y 
Travelling Salesman Problem — Least cost branch-and-boup, d 
technique can be used to find a minimum cost tour from a given 
nodes. For this, we need to define two cost functions @(*) and u) 
@(r)$c(r)< u(r) for all nodes r. 
The cost function c(-) should be such that the solution node Wi 
c() corresponds to a shortest tour in G. One way for deciding value of ef) 
C(A) = Length of tour defined by the path from then 
to A, if A is a leaf cost of a minimum cost ei 
the subtree A, if A is not a leaf. 


State space tree for such problem is shown in fig. 4.20 with each ey 
assigned a value indicates the root to be followed. 


For example, node 8 shows the path 1, 3, 4 and node 13 shows 
1, 3, 2, 4. Reduced cost matrix is used for finding better value of ¢(} i 
this, we have to reduce a matrix. A matrix is said to be reduced if its rowsal 
columns are reduced, and a row (column) is said to be reduced iff it conti 
at least one zero and all remaining entries are non-negative. 


We associate a reduced cost matrix with every node in the travel 
salesperson state space tree. Suppose that A be the reduced cost matrix fa 
node P and Q be a child for node P, also suppose that P is not a leaf chil. 
tree edge (P, Q) corresponds to including edge <i, j> in the tour. 

A reduced cost matrix for P can be obtained as follows - 

(i) Change all entries in row i and column j of A to ©. 
This prevents the use of any more edges leaving vertex i or entering ve 
(ii) Set AG, 1) to %, This prevents the use of edge (j, !). 


Gii) Reduce all rows and columns in the resulting matrix & 
Tows and columns containing only oo. 


Total cost of Q can be given as — 
: &(Q) = &P)+ A(i, j)+r 
where r is the total amount subtracted in step (iii). pi 
At each step of determining minimum cost tour we select 4 node | 


Set of 
Such 


if 


inimum cost and go ahead s pl i ly 
ji a te, la .d final | 
with a minimum Cost tour, -by-step by dc ing kote and } 4 
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nie ee iene tree Ret roblem using branch and bo 
eth de Generate a ay — - the following coat tgrbe = mind 

Ajo 12 7 4 
_B\|10 © 13 9 
“cl3 8&8 o I 

DLS 6 10 


©] (R.GPRY, June 2009, Dec. 2009) 
Or 
What do you understa ind by travelling salesman problem ? Discuss with 
suitable example. oan 
Ans, Travelling Salesman Problem — Refer to Q.27, 
Suppose the initial state is given by matrix — 


o 12 7 4 
10 » 13 9 
3 8 wo i 
5 6 10 @ 


Fig. 4.21 (a) Initial State Cost Matrix 
For finding the minimum cost tour we have to reduce the above matrix. 

For this we have to reduce each row and column of above matrix. Reduction 
can be done as follows — 

(i) Subtract 4 from row one 

(ii) Subtract 9 from row two 

(iii) Subtract 3 from row three 

(iv) Subtract 5 from row four. 


o 8 3 0 
10 4 0 
o 5 » 8 
015 @ 


Fig. 4.21 (() L=21 
Now, the above matrix is not reduced because it 
She zero but not all column contain at least one 


s all rows are contain at 


least zero. So, we further 


i: t 
Reduced it by setting at least one zero in all column of the a pee ae 
of the above matrix is ; 4 + 9 +3 +5=21. By subsracting ? Pa 8— 
" Subtracting 3 from column 3. The resulting matrix will be gi 
o 70 0 
raga i 
o 4 8 
oo? © 


SO 
Fig, 4.21 (c) Reduced Cost Matrix L = 2: 
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Cost of the resulting matrix is given by adding cost of its o; 
ie., 21 and the cost that is reduced from it i.e., 1 + 3, so, the conte 
matrix is; 21 + 1+3= 25. Hence, all tours in the original raph he 
at least 25. Vea al 
For this, we can show a tree representation of state space 
least cost branch and bound (LCBB) as shown in fig. 4.22, Starters 
node as the E-node, nodes 2, 3 and 4 generated. In tree nodes ae ry 
position of tour with minimum cost 25 as obtained by the matrix othe pa 
The reduced matrix for these nodes i.e., 2, 3 and 4 can be obtain 
following manner — ined, ing 
Reduced cost matrix for node 2 i.e., path (1, 2) will be obtained h 
yy 


(i) Setting all entries in row 1 to 0. 


om 2 © w 
1 o 1 0 
0 4 @ 8 
0 0 2 a 


Fig. 4.21 (d) 
(ii) Setting all entries in column 2 to «0 
[2 oo 7 
1 o 1 0 
0 m2 om 8 
Lo o 2 oo} 
Fig. 4.21 (e) 
(iii) Setting entry (2, 1) to © 


[jee 


oi 
+. 
0 m7 wo 8 
Oey, 2 ee] 
Fig. 4.21 () 


(iv) Reducing the cost of matrix by analyzing matrix of fig. eat 


We see that it is not in reduced form. So, we reduced this matrix by 8 

least one zero in column 3. The resultant matrix is — 

fo ao wm w 
2 2 0 0 
oo wo 8 
0 


{Hh oo 1 o 
Fig. 4.21 (g) L = 33 
(v) Cost of the matrix can be find by the formula — 


CQ) = C(P) + AG, j) +r 


Unit-IV 165 


wheres 
the cost 


€(Q) is the required cost, C(P) is the cost of original matri 
tof (ij) entry in matrix A, ris the total cost es aN 


C(2) = C1) + A(1, 2) +r 
=254+7+1=33 


similarly, reduced cost matrix for node 3 i. Path (1,3) will be obta 
(i) Setting all entries in row 1 tow ya 


(ii) Setting all entries in column 3 to co 
(iii) Setting entry (3, 1) tow 
(iv) Reduce the resulting matrix 
(v) Find the cost of the matrix. 
C(3) = C(1) + ACI, 3) +r 
=25+0+4 
=29 
Ca) - 
1 oo 0 
o 0 @ 4 
0 0 @ @ 


Fig, 4.21 (k) L=2 
Reduced cost matrix for node 4 i.e., path (1, 4) will be obtained by - 
(i) Setting all entries in row | to 


(i) Setting all entries in column 4 to © 
(iii) Setting entry (4, 1) to 
(iv) Reduced the cost matrix 
(v) Find the cost of the matrix. 
c(4) = c(i) + ACL, 4) +r 
=25+0+1 
=26 
Ls a we 
o 2 0 
042° 
io oN? 4 
Fig. 4.21 o L= oll — a4) 
wa ge hone he i cma sem 


——————‘Cé«~*™ 
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For this, we will use node 4 and resultant matrix with minimum cost, 
following steps will be followed — Pop & 
(i) Setting all entries of row 4 to <0 
2] 
° 


o 
ey 


Fig. 4.21 @j) 
Setting all entries in column 2 
[o 
0 


0 
o 


oO © 
0 @ 
o4 


o 0 © 


(i) toc 
oo] 
o 

© 
© 


Fig. 4.21 (k) 
(iii) Setting entry (2, 1) to co 


8888 
88o8 


Fig. 4.21 I) 


(iv) Reducing the cost of matrix of fig. 4.21 (J) by setting at ea 
one zero in all rows and all column. 


(v) Cost of the reduced matrix is — 
C(5) = C(4) + A(4, 2) +r 
=26+0+0=26 
Now, we compute the path (1, 4, 3) for node 6 with the following s# 
(i) Setting all entries of row 4 to 0 
(ii) Setting all entries of column 3 to 0 
(iii) Setting entry (3, 1) to «0 
(iv) Reduced the cost of matrix 
(v) Find the cost of matrix. 
C(6) = C(4) + AG, 3) +4 
=26+2+4=32 


o 
o 73 ow n 
0 
0 © 


oO © 


88o8 


oo 


Fig. 4.21 (m) L = 32 
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is 1, 
now 1S 
of steps is to 


@ 


be followed — 


Setting all entries of row 2 to « 


Fig. 4.21 (n) 
Setting all entries of column 3 to co 

‘ 

© 


0 


ii) 


Fig. 4.21 (0) 
(iii), Setting entry (3, 1) to «, which is already exist, 


(iv) Reducing the cost of matrix of fig. 4.21 (0) by analyzing at 
least one zero in all rows and columns 


cs 


888 
388 
888 

8888 


2 © 
Fig. 4.21 (p) L= 28 

Cost of the resultant matrix is — 

C(7) = C(5) + AQ, 3) +8 

C(7) =26+0+0=26 


(vy) 


erated by Procedure LCBB 
Jem initial and final positions 
on ‘minimum. cost 26. 


Fig. 4.22 State Space Tree Gen 


We kno i ing salesman P 
ate w that, in travelling sa! 5 
Same, Therefore, path is (1,4, 25 3, 1) with 
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is branch and bound method, using branch ang 
ec eran a Wiaie — =, - ge Sollowing cost matrix." 
Alo 12 7 4 
B\10 » 13 9 
G=cl3s 8 o U 
p\5 6 10 @ 


Ans. Refer to Q.23 and Q.29. 


ERICAL PROBLEMS 


Prob.3. Consider the travelling salesperson 


: o7i3ny 
instance defined by the cost matrix — 3 @ 6 Hy 
(i) Obtain the reduced cost matrix ; 8 2 6 Wt 
(ii) Using LCBB find least cost path. | ;3 jy 9 7 ul 
Or 

Consider the travelling salesperson instance defined by the cost mati. 

0 7 3’ 2 8 

3 wo 6 14 9 

s 8 om 6 I8 

9 3 S$ wo I] 


W 14 9 8 w 
Obtain the reduced cost matrix and solve it. 
(R.GPV., Dec. 2007, June 2014, Dec. 2014, 2U!) 


Sol. For finding reduced cost matrix of above matrix, first we t)" 


reduce its royzs. : 
Subtracting minimum cost from corresponding row. 
(i) Subtract 3 from R, (ii) Subtract 3 from Ry 


(ii) Subtract 5 from Rj (iv) Subtract 3 from Ry 
(v) Subtract 8 from Rs. 


Cost of matrix is (3 +3 +54 3+8)= 22. 
Resulting matrix is shown as below — 
o 4 


0 9 5) Ry=R,-3 
Oo » 3 nn 6 R2=R2-3 
© 3 © 1 133] R3=R3-5 
¢ © 2 © 8| Rg=Rg-3 
18 6-2 .0., Sl), GaswRs-8 


Fig. 4.23 Cost = 22 for Finding Reduced Cost Matrix 
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+h row in resulting matrix h: 
we see that eac! 8 a Zero entry, Also, all 
us have a zero entry except last (Cs) column — 
colu A 
the go subtracting 5 from last column >= 40 9 9 
Cs=C5-5 9 ean gy 
; = 0 3m 1 8 
The resulting rans is — a Ct hw g 
Total cost of resulting matrix is total 10 6 1 0 «@ 
sun de ducted, i.e., Fig. 4.24 Cost = 27 Reduced Cost 
X 22+5=27, Matrix 


Now, above matrix has one zero entry in each row and column so, this 
. . er 
atrix is the required reduced cost matrix. With cost 27, it indicates that 
tinimomn cost path has at least cost 27. 


Suppose, we start travelling from node | having cost 27 as shown in 
fig. 4.25. 


Fig. 4.25 State Space Tree Generated By LCBB 
Further we try to find the matrix for path (1,2) ive., x1 = 2+ 
Steps to be followed are — 
(Setting all the entries in the row 1 and column 2 to co 
Gi) Setting entry (2,1) to © 
Gil) Reducing the resulting matrix 
(iv) Find the cost of matrix. 


it /-Sem., 
170 Analysis & Design of Algorithm (B.E., 1V-Sem.) 


For (i) and (ii) we consider the matrix of fig. 4.24 as root Matrix, 


matrix is 


Maly 


oo 2 0 © 
oo 3 i il 
0» o 1 8 
62 2 @ 3 
10 © 1 0 © 
Fig. 4.26 All Entries of Row 1 and Column 2 to ~ also set 21) % 


(iii) We see that resulting matrix of fig. 4.26 is not redy 
reducing it we get 
(a) Subtract 1 from Ry (b) Subtract 2 from Ry. 


o 7 Oo 0 « 


ced, 


© © 2 1 0| R2=R2-1 
0 » » 1 8 
4 © 0 w 1| Rg=Rg-2 


10 @ 1 0 @& 


Fig. 4.27 For Path (1,2) 


Here, we see that all rows and columns have at least one 
resulting matrix is reduced. 


(iv) Total cost is 


Zer0 entry, 9 


C(2) = C(1) + A(1,2) +r 
C(2)=27+4+3=34 
This is shown in fig. 4.25 by one edge (1,2) having cost 34. 


In similar fashion we try to find path (1,3), i.e. for x; = 3. Steps folk 
followed are — 


(i) Make all the e: 
(3,1) to 0 


(ii) Reduce the matrix 
(ii) Find the cost of matrix, 


ntries in row 1 and column 3 to and set eat) 


@) 
a + 
09 © » 1 Wt 
Bas «o 1 8 
6 0 m2 wm 3 
1 6 © 0 ow 


. Fig. 4.28 For Path (1,3) 
(ii) For reducing we subtract 1 


Th i from third row. 
¢ resulting matrix is — 
om w@ oO o 
bd oS tt a 
cy BS mie, 
eee f z R3=R3-1 
W 6 o0 9 & 


Fig. 4.29 For Path (1,3) Cost = 28 
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t resulting matrix is not reduced as column 5 does not have any zero 
ee (Rs = Rs- 1) ie., reducing 1 from column 5, 
ent 7°” o 2 2 2 @ 
0 2 o Il oO 
20 0 6 Rs =Rs5- 
Sk a le SeRS el 
10 6 


> 0 @ 
Fig. 4.30 For Path (1,3) Cost = 29 
(iii) Total cost of this matrix is — 
C3) = C1) + A(1,3) +r 
=27+04+2=29 

This is shown in fig. 4.25 by edge (1,3) and cost 29, 
Further we try to find for path (1,4), ie., x, = 4. 
Steps to be followed are — 

(i) Set all the entries in row 1 and column 4 to «0 and set entry (4,1) to 00 

(ii) Reduce the matrix 

(iii) Find the cost of matrix. 


@ 
~~ 0 © © w 
0 © 3 » 1 
0 3 © wo 8 
o 0 2 wo 3 
10 6 1 @ @ 
Fig. 4.31 For Path (1,4) 
(ii) Reducing it — 
o 2 © mo w 
0 © 3 o 0 
R5=R5-1 
i 3 o 7 
C5 =C5-1 
2 0 2 @ 2| SS 
9 5 0» @ 


Fig. 4.32 For Path (1,4) 
(iii) Cost of this matrix is — 
C(4) = C(1) + A(1,4) +r 
=27+94+2 =38 
Itis shown in fig. 4.25 by edge (1, 4) and cost 38. 
For finding matri 5) we do 
ig matrix of path (1,5) 
@ Set all the entries in row 1 and column 5 to and set entry (5,1) 
to co 
Gi) Reduce the matrix 
(ii) Find the cost of matrix. 
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@ 
oo oO mo 
o © 3 Nw 
0 3 2 1 @ 
6 0 2 » ow 
o 6 1 0 ow 


Fig. 4.33 For Path (1,5) 
(ii) For reducing we subtract | from column 3 so, 


oo 2 © © 
0 © 2 I @w 
0 3 @ 1 @! Cz=C3-1 
6 0 1 2 © 
o 6 0 i} o 


Fig. 4.34 For Path (1,5) 
(iii) Cost C(5) = C(1) + A(1,5) + r=27+0 +4 1= 28 
It is shown in fig. 4.25 by edge (1, 5) and cost 28. 
Further, we go ahead by node of minimum cost, i.e., node 5 of cost, 
Further possible values of x2 are 2, 3 and 4 so, if x, = 2, ie., we ty fr 
path 1, 5,2 
Steps to be followed are — 


(i) Setall the entries in row 5 and column 2 to co and set entry() 
too 


(ii) Reduce the matrix 
(iii) Find the cost. 
(i) For this, we consider matrix of fig. 4.34 as root matrix- 


co 0 0 wm w 
oo 2 Il ow 
0 wm © 1 ow 
6 » 1 @ ow 


mo 0 0 mo wo 


Fig. 4.35 For Path (1,5,2) 


(ii) Above matrix is not P from second ™ 
and 1 from 4th row — reduced so, subtracting 2 


2 2 © «oo 
2-2 0 9 w 
0 @ © 1 @| R2=R2-2 
S @ 0 @ =| B4=Ra-t 
2 0 © © ow 

Fig. 4.36 For Path (1,5,2) 
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jn reducing 1 from column 4 — 
Aga 


eoseo8 
Boe 8 
8 8 8 8 


C4=Cg-1 


Bucs 8 
8888 8 


2 © @ 
Fig. 4.37 For Path (1,5,2) 
(iii) Total cost is C(6) = C(5) + A(5,2) +r 
=284+6+4 =38 
For finding path of (1, 5, 3), ie., x2 =3 - 
(0) Make row 5 and column 3 to « and make entry (3,1) to «0 
(ii) Reduce the matrix 
(iii) Find the cost. 


@ aoe & & 
0 © © 1 @ 
© 3 @ 1 @ 
6 0 © wo @ 
o oo @ @ 


Fig. 4.38 For Path (1,5,3) 
(ii) For reducing it we subtract 1 from row 3. 
Resulting matrix is 


oo 2 o © 
0 2 » ll @ 
wo 2 » 0 | R3=R3-1 
6 0 2 » @ 
on ao om @ 


Fig. 4.39 For Path (1,5,3) 

This matrix is reduced. 

(iii) Cost is C(7) = C(5) + A(S.3) + F 

=28+0+1=29 

It is shown in fig. 4.25 by edge (1, 5, 7). legis 
Further we try for path (1, 5, 4), steps to be followed are aes 

(i) Make row 5 and column 4 to © and make entry (4, 

Gi) Reduce the matrix 

Gii) Find the cost of matrix. 
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@ 


B8eo8 
ows 8 
=-8nrs 
888 8 
88 8 8 


o 0 Oo 0 
Fig. 4.40 For Path (1,5,4) 
(ii) For reducing it, we subtract 1 from column 3, 


2 © 
© © 
«© w| C3=C3-1 
~ © 


8BoS8B 
ows 8 


o 0 » @ 
Fig. 4.41 For Path (1,5,4) 
(iii) For finding total cost — 
C(8) = C(5) + A (5,4) +r=28+04+1=29 

It is shown in fig. 4.25 by edge (1, 5, 8). 

Further we continue with node of minimum cost, i.e., node 7 Of cost 

The next possible value for x; are 2 and 4, i.e., X3 = 2orx,=4, 
we try for x; = 2, ie., for path (1,5,3,2). 

For this we consider matrix of fig. 4.39 as root matrix, 

Steps to be followed are — 


(i) Make the entries of row 3 and column 2 as co and make enty 
(2,1) to « 


(ii) Reduce the matrix (iii) Find the cost. 
@ 


o 0 oO «© wo 
ooo ll «© 
2 0 Oo «@ wo 
6 D2 wm wo wo 
DB 0 om wo ow 


; Fig. 4.42 For Palth (1,5,3,2) 
(ii) For reducing it, we subtract 11 from row second and 6 from 


fourth, resulting matrix is 
om mo w© wo 
oa mo wo 0 @w 
° © © © w}! R2=R2-1 
0 m2 @ w@ ow 
Oo 2 Dm w oo 
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(ii) This matrix is reduced for finding cost 


C(9) = C(7) + A 3,2) +r=29 424 17=48 
tt is shown in fig. 4.25 by edge (1, 5, 7, 9) 
Further we try for path (1,5,3,4) ie. x5 = 4 
‘0 be followed are — 


steps t 
(i) Make the entries of row 3 and column 4 as oo, 
[oo no Do DM wo 
00 ® 2 @ 
2 0 © © wo 
6 0m w ow 
ee 


Fig. 4.44 For Path (1,5,3,4) 
(ii), Make entry (4,1) to oo. The resultant matrix is 


i. 


Oo mo © mo w 
0 om wo wo 
oo mn mo wo 
o 0 7 mo w 
2 0 0 mo wo 


Fig. 4.45 For Path (1,5,3,4) 
(iii) The matrix is already in reduced form. 
(iv) For finding total cost 
C(10) = C(7) +A (3,4) +r =29 +04+0=29 
Itis shown in fig. 4.25 by edge (1, 5, 7, 10). 


Now, we proceed with node having minimum cost. So, we proceed with 
node 10 having cost 29, 


The path known till now is 1,5,3,4. 

The last choice we have is 2 ie., x4=2 
(i) Make row 4 and column 2 as « and make entry (2,1) to © 
(ii) Reduce the matrix 

, (ii) Find the cost of matrix. 

Le., for path (1,5,3,4,2) - 
@) 


888 8 8 
8 8 8 8 


© 


is 3,4,2) 
Fig. 4.46 For Path (1,5,3,4, if 
(ii) Above matrix is already reduced, so no changes are neet 


888 8 8 
8888 8 
8888 8 
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id as — 
iii) Total cost can be foun: 
(iii) Tot C(I1) = C(10) + AG,2) += 29 +04+0=29 
It is shown in fig. 4.25 by edge e 5,7, 10, - 7 
i i n problem initial ang 
ow we know that in travelling sal lesperso! J nit Hige 
are ee path of minimum cost is (1,5,3,4,2,1) with minimum conn 
Prob.4. Solve the TSP using branch and bound technique. 


(R.GRY, June 20n 
Sol. First convert the given matrix into reduced cost matrix 


A B C 
Ajai 2) .3 
B}S «2 3 
cClL2 4 


(i) Subtract 2 from row 1 

(ii) Subtract 3 from row 2 

(iii) Subtract 2 from row 3 
Resultant matrix 


A BC 
Ajo 0 1 
BJ2 © O 
Clo 2 


Cost of the above matrix is the sum of the 
total cost reduced from the original matrix. 
ie, 2+342=7 

The resultant matrix is reduced matrix 
because its rows and columns have atleast one 
zero value. 

Now generate the state space tree. 

Hence, Path=A>B >Co>A 

Cost=2+3+2=7 

Prob.5. Consider the. 

Problem. Solve this Prob 


Fig. 4.47 State Space ™* 


following initial cost matrix for traveling sales! 
lem using branch and bound technique. 


7 mig 
09) 
e 46 we (R.GPVs Now? 


* bray 
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Sol. First convert the given matrix into Teduced cost matrix, 
AB 
Alo 4 
B)7 co 
Ccl4 6 


8 Uu2 


(i) Subtract 4 from row 1 

(ii) Subtract 5 from row 2 

(iii) Subtract 4 from row 3 
Resultant matrix 


A 
Ajo 


B) 2 
clo 2 co) 


8 ow 
or0N 


Cost of the above matrix is the sum of the total cost reduced from the 


original matrix. 
1e4+5+4=13 


The resultant matrix is reduced matrix because its rows and columns 


have atleast one zero value. 


Hence, Path=A+B>3C3A 
Cost=4+5+4=13 


Prob.6. Solve the following instance of the Knapsack problem by the 
inch and bound algorithm. 


Item | Weight | Value | Value /Weight 


1 4 40 10 
2 7 42 6 
3 5 25 5 
4 3 12 4 


Z, Dec. 2016 
The Knapsack capacity m is 10. (R.GRY,, Dec. 2016) 


Sol. Fig. 4.48 shows the solution of given knaps 
®nce the result is 


Ans. 
1, Xp, x5, x4) = (1, 0, 1, 0) 


gorithm (B.E., I \V-Sem.) 
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Fig. 4,48 Solution of Knapsack using Branch and Bound 


Prob.7. Draw the portion of state space tree generated by LC brank 
and bound for the following Knapsack instance n = 4, (P,, P,, P3,P,)= 
(10, 10, 12, 18); (W,, Wz, W3, Wy = (2, 4, 6, 9) and M = 15. 

(R.GP.V., June 2014, Dec, 201) 

‘Sol. Let us trace the working of an LC branch-and-bound search wsitg 
C(.) and u(.). We continue to use the fixed tuple size formulation - Te 
search begins with the root as the E-node. For this node, node L of fig. 4, 
We have C(1) =-38 and p (1) =— 32. 


Upper Number = © 


Lower Number =u 
Fig. 4.49 LC Branch-and-bound Tree 
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‘the computation of u(1) and €(1) is done as fou 
value U Bound (0, 0, 0, 15). U Bound Scans throu, 
has t starting from j. It adds these objects into the 
to seh that does not fit is encountered. At this time, 
objec! of all the objects in the knapsack plus Cw 
ae C and b start with a value of zero, For 
eats ed by 2, 4 and 6 respectively. When i = 
mils and hence the value returned is — 32. Function Bound is similar to 
Bound, except that, it also considers a fraction of the first object that does 
not fit the Knapsack. For example, in computing (A), the first object that 
does not fit is 4 whose weight is 9. The total weight of the objects 1, 2, and 
3is 12. So, Bound considers a fraction 3/9 of the object 4 and hence returns 


Ows. The bound u(1) 
igh the objects from left 
Knapsack until the first 
the Negation of the total 
18 returned. In function 
1= 1,2 and 3, C gets 
4, the test (C+ w [i] < m) 


3 
32-=—*18=-38. 
- 9 


Since node 1 is not a solution node, LCBB sets ans = 0 and upper =-32, 
The E-node is expanded and its two children, nodes 2 and 3, generated, The 
cost €(2) =-38 , C3) =~—32, u(2) =— 32, and u (3) =—27. Both nodes are 
put onto the list of live nodes, Node 2 is the next E-node, It is expanded and 
nodes 4 and 5 generated. Both nodes get added to the list of live nodes, Node 
4isthe live node with least C value and becomes the next E-node, Nodes 6 
and 7 are generated. Assuming node 6 is generated first, it is added to the list 
of live nodes. Next, node 7 joins this list and upper is updated to — 38, The 
next E-node will be one of nodes 6 and 7. Let us assume it is node 7. Its two 
shildren are nodes 8 and 9. Node 8 is a solution node. Then upper is updated 
'o~38 and node 8 is put onto the live nodes list. Node 9 has c(9) > upper and 
iskilled immediately. Nodes 6 and 8 are two live nodes with least C . Regardless 
ot Which becomes the next E-node, C(E)> upper and the search terminates 
“ith node 8 the answer node. At this time, the value — 38 together with the 
math 8, 7, 4, 2, 1 is printed out and the algorithm terminates. From the path 
St cannot figure out the assignment of values to the xs such that Epix} = 
“per, Hence a proper implementation of LCBB has to keep additional 
formation from which the values of the x;'s can be extracted. One way is 

© 8Sociate with each node a one bit field, tag. The sequence of tag pis aa 
S @nsWer node to the root give the x; values. Thus, we have ly ae a 
6) = tag (8) = 1 and tag (3) = tag (5) = tag (7) = tag 9) = 0- 


=d = =1,and 
x i. for the path 8, 7, 4, 2, 1 is 1011 and so X, = 1, %3= 0, % 
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MEANING OF LOWER BOUND THEORY AND ITs Use 


VING ALGEBRAIC PROBLEM, INTRODUCTION 
ea PARALLEL ALGORITHMS NT 


0.31. Explain the term lower bound with suitable example, 
. _ RGRY, Dec, a, 

Ans. Lower bound is an estimate of a number of operations Needed tg J 
a given problem. If f(n) is the time for some algorithm, then wee 
f(n)=Q(g(n)) to mean that g (n) is a lower bound for f (n), Fomall, & 
equation can be written if there exist positive constants c and a, suck Fy 
|f(n)[z clg (n)| forall n> n,. For example, in sorting (comparison-base) 
searching ina sorted array the lower bound is 2 (n logn)andQ (logn) respecte 


0.32. Explain lower bound theory and its use in solving algeiny 


problems. (R.GP.V., June 2009, Dec. 2009, June 20h 
Or 

Write a short note on lower bound theory. (R.GPV, Dec. 2019 
Or 


What is the meaning of lower bound theory and how can it be usedir 
solving algebraic problems ? (R.GRV., May 201), 
Ans. Lower bound theory is a technique that has been used to estblat 
that a given algorithm is the most efficient possible. This is done by discovers 
a function g(n) that is a lower bound on the time that any algorithm must ae 
solve the given problem. Now if we have an algorithm whose computing tims 
the same order as g(n), then we know that asymptotically we can do no bet 
If f(n) is the time for some algorithm, then we write f(n) = ga) 
mean that g(n) is a lowerbound of f(n). This equation can be written fe 
there exists positive constants c and ng such that {f(n)| > ¢ |g(")] for ag 
In addition to developing lower bounds to within a constant factor, wear 
concious of the fact to determine more exact bounds whenever this is post 
Deriving good lowerbounds is more difficult than devising ¢ 
algorithms. This happens because a lower bound states a fact about all at 
algorithms for solving a problem. Generally we cannot enumerate @ 
all these algorithms, so lowerbound proofs are often hard to bie B 
The proof techniques that are useful for obtaining lower bount io 
() Comparison Trees — Comparison trees are the oonra 
model useful for determining lower bounds for sorting and searchingP” 


(i) Oracles and Adversary Arguments — One of the pron a 


that is important for obtaining lower bounds consists of making 


Unit - 
je. The most famous oracle in histo, never 


baa jn Delphi, Greece. Still this oracle 
“1 embedded in some rocks. In olden times 
oe a question. After some period of time iy fis io 
ie d caretaker would interpret the oracle Teply, : " 
similar phenomenon happens when we use al 
unds. Given some model of computation such 
wate tells us the outcome of each comparison, 
pound, the oracle tries its bestto cause the algorithi 
it does this by choosing as the outcome of the next test, the result that causi 
the most work to be required to find the final answer, Also if keeps track a 
the work that is done, a worst-case lower bound for the problem can be derived 


(iii) Lower Bounds through Reductions — This is a very important 
technique for getting lower bounds. This technique calls for reducing the 
given problem to another problem for which a lower bound is already known. 
We define it as follows — 

Let us consider that P, and P, be any two problems. We say P, reduces 
to P (also written P, oc P2) in time 7(n) if an instance of P, can be converted 
into an instance of P2 and a solution for P; can be obtained from a solution for 
P, in time < 7(n). 

Let us take an example to understand it. Suppose P, be the problem of 
selection and P, be the problem of sorting. Suppose the input have n numbers. 
Ifthe numbers are sorted, say in an array A[ ], the ith— smallest element of the 
input can be obtained as A[i]. Hence P, reduces to P, in O(1) time. 

It should be noted that if P, reduces to P, in “(n) time and if T(n) be the 
lower bound on the solution time of P,, then, clearly, T(n) — “(n) is a lower 
bound on the solution time Py. 


, (iv) Techniques for Algebraic Problems — Substitution and linear 
independence are two methods used for deriving lower bounds on algebraic 
and arithmetic problems. The algebraic problems are operations on integers, 
Polynomials and rational function.» 
ties Straight-line program is the model used 
‘use there ing instructions al nab 
OW a way ee see for n inputs, then a set of amelghting 
Programs, one each for solving a different size n, can be given. Phe ne y 
Statement used in straight-line program is the assignment nie aly a 
ry PP 4; where s, p, q are variables of ‘bounded size and op is typ’ 


nthe arithmetic operations — addition, subtraction, multip ants ai 
teover . ‘onstants, input variables, or variables 
al P and q are either c pent statement. 


'Y appeared on the left of an assign" 


TOSS Oracle and 
cle would reply 


Nn oracle to establish lower 
as comparison trees, the 
For getting a good lower 
'm to work as hard as it can. 


for computation. It is called so 


llowed. This means that if we 
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i ible straight-line program th, 
der, for example, one possil At 
th sient . degree-two polynomial ax? + ayx + ag has the form my 
“ V2 =a, *% 
Vi +a;,; 


Now to calculate the complexity of a straight-line Program, we 
that each instruction takes one unit of time and requires one unit of» 
Then the time complexity of a straight-line program is its number of asgi 
or its length. A more accurate assumption takes care of the fact than an int 
n requires [log n| + 1 bits to represent it. Since here operands are Small, un. 
cost assumption is appropriate. 

Q.33. Discuss parallel algorithm briefly. 

Or 
Explain parallel algorithms with suitable examples, 
(RGB, Dec. 201) 


(RGBY, June 2 


Or 
Write about parallel algorithms with example. (R.GP.V., Dec, 2013) 
Or 
Write short note on parallel algorithm. 
(R.GPV., June 2017, Dec. 2017, May 2018, Nov. 201!) 
Or 
Write a detailed note on parallel algorithms. — (R.GP.V., May 201) 
Ans. Parallel machines are computers with more than one Laer 
Even the fastest single-processor machines may not be able to come by 
solutions within tolerable time limits. Parallel machines offer the potent 
decreasing the solution times enormously. on 
The idea of parallel computing is very simple. Given a problem Br 
we partition the problem into many subproblems; let each pee tie e 
a subproblem; and when all the processors are done, the partial solutio! 
combined to arrive at the final answer. sonal nat 
RAM (Random Access Machine) is the sequential cont TE ” 
In RAM model we assume that any of the following operations can 
one unit of time — addition, subtraction, multiplication, division, seeped 
memory access, assignment and so on. This model is widely 2° npul 
valid sequential model. On the other hand when it comes to parallel sign i 
numerous models have been proposed and algorithms have been di 
each such models. ; yeti? 
A very important feature of parallel computing that is absent!" ot 
computing is the requirement for interprocessor communication. For 


Unit- IV 18; 
ny problem, the processors have to a 


e on the subproblems each with wo; 
. ommunicate to see whether every one 
0 © < 


communicate among themselves 

tk on. Moreover, they also Tequire 
finished its task and so on. Each 
ae be assumed to be RAM. 
‘ay the i r 
Hon ication. Broadly, parallel models can be sr fal ae 
a (i) Fixed connection machines and 


(ii) Shared memory machines, 


give a 
and a 


A fixed connection network is a graph G 
rocessors and whose edges represent communi 
sie the degree of each node is assumed to 
increasing function of the number of nodes in 
mesh, hypercube, butterfly and so on. Fig. 4, 
connection machines. 


(V, E) whose nodes represent 
cation links between Processor, 
be either a Constant, or a slowly 
the graph, Examples include the 
50 shows the examples of fixed 


(a) Mesh 


(b) Hypercube (c) Butterfly 
Fig. 4.50 Examples of Fixed Connection Machines 
Here, in this model, interprocessor communication is done through the 
communication links. Any of the two processors connected by an edge in G 
‘an communicate in one step. Generally two processors can communicate 
ugh any of the paths connecting them. The communication time that is 
*eeded, depends upon the lengths of these paths (at least for small packets). 
In shared memory models [also called PRAMS (Parallel Sai se 
‘chines)], a number (say p) of processors work ial y aad 
“ommunicate with each other by using a common block of glot ae ee 
*is accessible by all. This global memory is known a Sa 
"ory. Fig 4.51 shows a parallel random access machine. 


sae =’ 


BBB eee 


Fig. 4.51 A Parallel Random Access Machine 
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Here communication is done by writing to and/or Teading § 
mon memory. Any two processors ! and j can communicate in two 


com! * . 
i writes its message into memory cell j K 


(i) Processor 
(ii) Processor j reads from this cell. 
However; ina fixed connection machine, the communication time 

on the lengths of the paths connecting the communicating Processors 
processor in a PRAM is a RAM with some local memory. A single Step 
PRAM algorithm can be one of the following — comparison, assign a 
arithmetic operation (such as addition, division, and so on), memo; 
(local or global), ete. Typically, the number of cells (m) in the global 
is assumed to be the same as p. However this is not always the case, Inj 
there are algorithms for which m is much larger or smaller than p, Here we 
assume that input is given in the global memory and there is space for the 
output and for storing intermediate results. As the global memory is accessit 
by all processors, access conflicts may arise. However what happens if mo 
than one processor tries to access the same global memory cell (for the pupog 
of reading from or writing into) ? There are many ways of resolving read af 
write conflicts. Accordingly, many variants of the PRAM arise. 

EREW (Exclusive Read and Exclusive Write) PRAM is the shared memy 
model in which no concurrent read or write is allowed on any cell of the gl 
memory. Here point to be noted is that ER and EW do not preclude differed 
processors simultaneously accessing different memory cells. CREW 
(Concurrent Read and Exclusive Write) PARAM is a slight variation thatallows 
concurrent reads but not concurrent writes. Similarly ERCW model is defined 
Finally, the CRCW PARAM model permits both concurrent reads atl 
concurrent writes. 

a 


BINARY SEARCH TREES, HEIGHT BALANCED 
2-3 TREES, B-TREES sca 


0.1. Explain binary search tree, List out its properties, 
(R.GPV, Dec. 2014) 


Or 

Define binary tree. (R.GRV,, June 2015) 
Or 

Write the rules to construct binary search tree. (R.GRV, June 2016) 
Or 


Write short note on binary search tree. (R.GBRV., Dec. 2017) 
Ans. A binary search tree is a binary tree that is either empty or in which 
every node contains a key and satisfies the following properties — 
: (i) The key in the left child of a node (ifit exists) is less than the key 
in its parent node. 
(ii) The key in the right child of a node (if it exists) is greater than 
the key in its parent node. 
(iii) The left and right subtrees of the root are again binary search trees. 
(iv) Every element has a key and no two elements have the same key. 
0.2. is bis Give a comparison of binary search 
fhee'stey ni is binary search tree ? GRY, Dee rth 
Ans. Binary Search Tree — Refer to Q.1. a i 
h Comparison of Binary Search Tree and Heap — The ee 
'*2p excludes them from being binary search trees eeaacienen condition 
reas child cannot be greater than its parent, which is @ necessary 
"a binary search tree. H 
i= binary sear e enksin 8  cptin 
= tree can become skewed, which Lay minimum height. The heap is 
heap, on the other hand, is always # tree ° 
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accessing any randomly selected element, 

7 iority queues. The acces: 
erations defined for priority q Cessing gti 

at her pmn specifies that only the largest element can be ea 

S a peratibae specified for priority queues, therefore, the heap jg ane + Fay 


choice. . = 
Q.3. How search can be applied on a binary search tree ? Explain yg 


example. Or 


it i i h tree T for an iden: 

Write an algorithm to search a binary searci an iden 

“Assume that each node in T has three fields LCHILD, DATA and nine 

What is the computing time of your algorithm. (R.GPY,, Dec iy 
Or 


not a good structure for 


For a given binary tree, design an algorithm to verify it is q binay 
search tree or not. Also find the complexity of your algorithms, 
(R.GPV, June 20 
Ans, The most common operation performed on a binary search tree, 
searching for a key stored in a tree. We use the Q 
algorithm 5.1 to search for a node with a given 
key in a binary search tree. We have been given (6) 0 
a pointer to the root of the tree and a key k. 


TREE-SEARCH returns a pointer to a node with 
key k if one exists, otherwise, it returns NIL. (3) @ @ C 
Algorithm 5.1 GC) @ (9) 


TREE-SEARCH (x, k) 
1. if x = NIL or k= key [x] (9) 
2. then return x ‘i i nt 
: ee Fig. 5.1 Binary Search 

4. then return TREE-SEARCH ((left [x], k) 

5. else return TREE-SEARCH (right [x], k) 

For example, consider the fig. 5.1. 

The procedure begins its search at the root 40 
and then traces a path downward in the tree as 
shown in fig. 5.1. For each node x, that it 
teaches, it compares the key k with key [x]. If 
the two keys are equal, the search terminates. If 
k is smaller than key [x], the search continues 


in the left subtree of x, as the binary-search-tree 18 
Popedty means that k could not be stored in the \ 
Tight subtree. Symmetrically, if k is larger than bas 


key [x], the search Continues in the right subtree. Fig. 5.2A Binary” i 


‘For'example, see fig. 5.2. Tree and ‘Search lo 
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ie, 40, 18 < 40. 
item (i) So, we have to search left subtree 
(iii) Comparing 18 with 10 here 10 < 
ent 10. 
(iv) Compare 18 with 25. 18 < 25 80, 18 is there, in left subtr f 
ment 25. . om 
(v) Compare 18 with left subtree of element 
we get the require position. 
path of search is shown by shaded area in fig. 5.2, 
‘omputing Time of Algorithm ~ A binary sear: i 
‘3 ooh by key as well as the rank in O(h) ape ii aici 


0.4. Write an algorithm to insert an item into a binary search tree and 
find the complexity of this algorithm. 

Ans. Another important operation is to create and maintain a binary search 
tree. While inserting any node, we should take care that the resulting tree 
satisfies the properties of a binary search tree. A new node will always be 
inserted at its correct position in the binary search tree as a leaf. 

For example, if we have following set of items to be inserted into a binary 
search tree i.e. 

10, 15, 12, 7, 8, 18, 6, 20 

First of all, we initialize the tree, to create an empty tree we must initialize 
toot to null. The first node will be inserted into the tree as shown in fig. 5.3 (a). 

Since 15 is greater than 10, it must be inserted as the right child of the 
Toot as shown in fig. 5.3 (b). 

Again 12 is larger than root, it must go to the right subtree of the root. 
Now it is smaller than 15, so it must be inserted as the left child of the root as 
shown in fig. 5.3 (c). 

_, Next number 7 is smaller than the root, thus it must be inserted as the left 
child of the root as shown in fig. 5.3 (d). P 
fi Similary 8, 18, 6 and 20 can be inserted at the proper place as shown in 
'B 5.3 (e), (f, (g) and (h) respectively. 

Root 


- © © 


of root element, 
18, so search in right subtree 
of elem 


el 
25, ie. 18, So, here 


Root 


(@) (b) (CZ) 
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Root 


© 
eo © @) (3) 
©) © © ®@® 
. ms 


Fig. 5.3 
To insert a new value V into a binary search tree T, we use the procedut 
5.2 TREE-INSERT. The procedure is passed a node z for which key [2]=wkt 
[2] = NIL, and right [2] = NIL. It then modifies T and some of the fields ofzi 
such a way that z is inserted into an appropriate i.e,, correct position in thet. 
Algorithm 5,2 
TREE-INSERT (T, z) 


l. y«NIL 

2. x © root{T] 

3. while x # NIL 

Ay doy<x 

5. if key[z] < key[x] 

6. then x < lefi[x] 

1 else x < right[x] 

8. Piz] y 

9. ify=NIL 

10. then root(T] < z 

I. else if key[z] < key[y] 
i then left[y] — z ; 


else righty] < z 
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he tree and traces a path 
Ointer y is maintained as 
ines 3-7 causes these two 
pending on the comparison 
n this NIL will Occupy the 
Lines 8-13 set the Pointers 
of this procedure runs O(h) 


REE-INSERT procedure begins at the root oft 

Tt d. The pointer x traces the path, and the Pp 
ownwar ex: After initialization, the while loop in | 
the Leathes move down the tree, going left or Tight de 
pointe with key[x], until x is set to NIL. The: 
of keyl where we wish to place the input item z, 
em z to be inserted. The time complexity 
oo on a tree of height h. 


0.5. Explain with the help of algorithm, to delete an item from the binary 

search tree. Also give an example to a an item from the binary search tree. 
ie 
Explain the Sunction for deletion of a node from binary search tree. 
(R.GBV., Dec. 2015) 

Ans. Another important function for maintaining binary search tree is to 
delete a specific node from the tree. The method to delete a node or item depends 
on the specific position of the node in the tree. The procedure for deleting a 
given node z from a binary search tree takes as an argument a pointer z, The 
procedure takes the three cases as shown in fig. 5.4. If z has no children, we 
modify its parent p[z] to replace z with NIL as its child. If the node has only a 
single child, we “split out” z by making a new link between its child and its 
parent. Finally, if the node has two children, then we splice out z’s successor y, 
which has no left child and replace the contents of z with the contents of y. The 
three cases are described below in the fig. 5.4. Fig. 5.4 deletes anode z froma 
binary search tree. In each case, the node actually removed is lightly shaded. (a) 
Ifzhas no children, we just remove it (b) Ifz has only one child, we splice out 
2(c) Ifz has two children, we splice out its successor y, which has at most one 
child and then replace the contents of z with the contents of y. 


(@ 
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© 
Fig. 5.4 Deleting an Item in Binary Search Tree 
Algorithm 5.3 
TREE-DELETE (T, z) 


if lez] = NIL or right{z] = NIL 


then y <— z 


Unit - Vv 
else y < TREE-SUCCESSOR @ 191 


3 ig tefily) + NIL 

5. then x < left[y] 

é else x < right[y] 

7. if x # NIL 

3. then p[x] < ply] 

9. if ply] = NIL 

10. then root[T] + x 

i. else if y = left[ply]] 

12. then left[p[y]] <x 
13. else right[p[y]] < x 
14. ify#z 

15. then key[z] <— key[y] 
16. > if y has other fields, copy them, too. 
17. return y 


In lines 1-3, the algorithm 5.3 determines a node y to splice out. The node 
ymay be the input node z (if z has atmost 1 child) or the successor of z (if z has 
two children). Then, in lines 4-6, x is set to the non-NIL child of y, or to NIL if 
yhas no children. The node y is spliced out in lines 7-13 by modifying pointers 
in ply] and x. Splicing out y is however complicated by the need for proper 
handling of the boundary conditions, which occur when x = NIL or when y is 
the root. Finally, in lines 14-16, if the successor of z was the node spliced out, 
the contents of z are moved from y to z, overwriting the previous contents. The 
node y is returned in line 17 so that the calling procedure can recycle it via the 
free list, The procedure runs in O(h) time on a tree of height h. 

0.6. Define height balanced trees. Write the properties of it 

(R.GRY, Dec. 2011) 
Or 
What is AVL tree ? Discuss its properties. 


be balanced a height in a trees? 
(R.GRY, May 2018) 

_ Ans. A height balanced tree is a binary tree in which the difference in 
eights betirvan the left and the right subtree is not more than one for every 
Node. The height ofa binary tree is defined as the maximum level of its rae 
ae height of a null tree is defined as ~ 1. This property ar aaa 
582 by two Russian Mathematicians, GM. Adel’son— Vel ste ce . 
“ce, the resulting binary trees are also called AVLirees in nel . 
To maintain, the height balanced property, it is actually no! i ahs 

Ow the height of each subtree. We can obtain it Oe rte eR and right 
that indicates the difference 1" heights of the 


(R.GRY, June 2014) 


Or 
What is height balanced trees ? Why to 


balance factor 
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node in a balanced binary tree has a balance o¢ a 
Se Eas the height of its left subtree is greater than, be a 4 
equal to the height of its right subtree. A value of 1 shows that the leg Chil . 
‘heavier’ and there is a path from root to eatin the left child Subtree of] z 
n, whereas the longest path in the right child subtree is length n— 1, wat 
factor of 0 will show that the longest paths in the two child subtrees aeegn 
while a value of — 1 shows that the right child possesses the longest Path, ia) 
5.5 (a) shows a balanced binary tree. It also shows the balance Of each wot 


(a) Balanced Binary Tree 
Fig. 5.5 
In a balanced tree each node must be in one of the three states — 1,01 
If there is a node in a tree where this is not true, then such a tree is said toh 
unbalanced. For example the trees shown in fig. 5.5 (b) are unbalanced tree. 


(6) Unbalanced Binary Tre 


Q.7. Write an algorithm for inserting a new node into an AVL tree. 


Ans. For inserting a new node into the AVL tree, an algorithm is given 
algorithm 5.4, 


Here, ‘newnode’ indicates that new node to be inserted into the tree. 
bf denotes balance factor, type of balance factor is (LH, FQ, RH) 
LH — denotes left higher 

EQ — denotes equal height 

RH — denotes right higher, 

AVL tree is pointed by root node, first of all we check whether root 


or not. If root node is nil, then it indicates that tree is empty and 


is to be inserted at the Position of root of AVL tree. Its left and right" 
are set to nil, 


Second! 
node to k 


is nil 


ly, if root node is not nil, then, we check the key vale of 4 
ey of newnode if both are equal then, as duplication is aes se 
new node is restricted. If key value does not match with key" 
node then newnode is inserted ei i i 


root depending On its key value. 


if newnode key is less than key of root 
left newnode, tallersubtree) otherwi, 
WV. node, tallersubtree). 


Here tallersubtree is a boolean type. Itretums 
ra subtree is increased else, it returns false, 
of Algorithm 5.4 Insertion into an AVL Tree 
Algorithm InsertAVL(var root; treepointer; 
newnode: treepointer; var taller: Boolean); 


true if after insertion height 


1. 


Pre: The root of the AVL tree is Pointed to by roo is 
{ new node to be inserted into the tree. ie eaaig 
Post: Newnode has been inserted into th 


1 ; 1 AVL tree with taller I te 
true if the height of the tree has increased, false ‘Mierwin ° 


Uses : InsertAVL recursively, RightBalance, LeftBalance.} 

2. var 

3, tallersubtree: Boolean; {Has the height of a subtree increased?} 
4, begin 

s if root = nil then begin 
6 root := newnode; 

1. roott.left = nil; 

8 roott.right := nil; 

9. roott.bf := EQ; 

10. taller := true 

I. end 

12. else with roott do 

if newnodet.entry.key = entry.key then 


i Error(‘Duplicate key is not allowed in AVL tree.') 
else if newnodet.entry.key < entry.key then begin 
{Insert in the left subtree} 
4 InsertAVL(left, newnode, tallersubtree); 
1g, if tallersubtree then {Change the balance factors.} 
19, case bf of 
20, LH: LeftBalance; - a 
4 EQ: begin bf = LH; taller := true end; 
n RH: begin bf = EQ; taller := false end 
y end — 
4, else taller := false 
2%, end : 


in the right sultice} 
else begin dinseosn eh 
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InsertAVL(right, newnode, tallersubtree); 


@ if tallersubtree then 

28. case bf of 

29. LH: begin bf := EQ; taller := false eau, 

30. EQ: begin bf := RH; taller := true eng; 

31, RH: RightBalance 

32. end 

33. else taller := false 

34, end 

oa baa {procedure insertayy 


As we must keep track of whether an insertion has increased the bei 
or not. So that balance factor can be changed appropriately, 


0.8. How can rotation be done in AVL trees ? Explain. 

Ans. In the cases when insertion of a newnode into the AVL tree Tesultiy 
increase of height of longer subtree that result into a tree that has difference t 
height of 2 between left and right subtree of root. Now, resulting tree does ny 
satisfy the requirements of an AVL tree. 

For restoring the balance, we have to rebuild part of the tree - 

For example, suppose that new node is inserted into the right subtree, is 
height has increased, and the original tree was right higher. Now we wishio 
balance this tree, 

Suppose, root node of AVL tree is r and its right child is denoted by. 


(i) Right Higher Left Rotation — Right subtree has height hl 
than left subtree as shown in fig, 5.6 (a). The action needed in this case is‘ 
rotation”. In this case as shown in fig. 5.6 (b), we rotate the tree leftwart, 


Total Height =h +3 


Total Height =h+2 


(@ Before Rotation (b) After Rotation 
Fig. 5.6 Restoring Balance by a Left Rotation 


Unit - 
comes the new root of the tree an, Init-V 195 


von child of new root x. 
nn rotation the height of rotated tree jg decreased by | 
‘Algorithm for left rotation is given in algorithm 5,5 y 1. 


Algorithm 5.5 Left Rotation Algorithm 
Algorithm RotateLeft(var p: treepointer); 
(pre: pis the root of the nonempty AVL s 
right child is nonempty, 
post: The right child of p becomes the new 
left child of the new p.} 
yar rightchild; treepointer; 
begin {procedure RotateLeft} 
if p = nil then 
Error(‘It is impossible to rotate empty tree in RotateLeft.’) 
else if pT.right = nil then 


Error(‘It is impossible to make empty subtree the root in 
RotateLeft.') 


d . 
Node r LE€., root node becomes 


ubtree being Totated, and its 


P. The old p becomes the 


8 else begin 
9, rightchild := pT right; 
10, pt.right :=rightchildT.left; {Move right subtree to intermediate 
node.} 
: rightchild’ left = p; {Drop p into left subtree} 
2, P :=rightchild {Change p to former right subtree.} 
13, end 
14, le 
end; {procedure RotateLeft} 


warren Algorithm first of all we check that the root of AVL tree is nl or 
ror tas mu, indicates that tree is empty and so no rotation is possible, and an 
Sen, ee is given. 
til ton aim We check that whether the right child of root is nil or not. ii 
So Totation is not allowed, as an empty node cannot be root ofan 
inally Ze aa error message is given. se Di 
ere ; Tightchild of root is not empty then left rotation is - a ” 
Xi an 7 Onsider that p denotes the root node. Node p is moved’ 'e 
ntermediate node called rightchild. 
is Left Higher — when the height of lefts 5 
ight of sey cae needed in this case 1S right rotation. 


tay subtree is higher 
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For example, see fig. 5.7 (a). Here, height of left and right su 
r differ by 2. So, 


(a) One of T, or T; has Height h (b) Height h + 
Total Height = h + 3 


(c) Heighth+2 
Fig. 5.7 Restoring Balance by a Double Rotation 


we have to first right rotate tree rooted at node x 


7 0 
Q.9. Define height balanced tree. Explain all the rotations pet, 
balance the tree with example. (R.GPY, srt 


Ans. Refer to Q.6 and Q.8. 


Q.10. How deletion can be performed on an AVL tree? 


Ans, When we delete a node from an AVL tree, if its height isun ancl 


then we need to rotate it either left or right so as to keep its height be 
as an AVL tree. 


mt 


faa | 
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this is shown in fig. 5.8. ; 


Height 
Unchanged 


of Algorithm (B.E., |V-Sem.) 
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8 to root node P. It results into 
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(ii) Left rotate the tree correspondin, 


- nt balanced tree rooted at node r, 
, heigh a 


Initial : 


| 
| 
| 
| 


h-1 


Case 3(c) 
Fig. 5.8 Sample Cases, Deletion from an AVL Tree 


Case 1 — In first case after deletion of a node from left subtree of my 
node, the height of tree remain unchanged. The resulting tree is an AVL tre, 
so no need of rotation. 

Case 2 — In this case after deleting a node from left subtree of root nok 
height of the tree is reduced, but now the resulting tree is height balanced. 
has equal height in both right and left subtrees. 

Case 3 —In this case height of left subtree of root node is h while the hei! 
of right subtree of root node is h + 1 i.e., difference of 1, we say it right high 

If we delete a node from left subtree than it results into a tree thats 
height difference of 2. 

For balancing it we rotate it left. By this resulting tree has height unchangt 

Case 4 — In this case height of left-subtree of root node of tree ish wit 
the height of right subtree is h + 1. 

If we delete a node from left subtree of root node then the diffe 
between the heights of tree is 2. 

For balancing it we have to rotate left corresponding to root node P- 
resulting tree is AVL tree with height reduced by 1. 

_ Case 5 — In this case left subtree has height h while right subtt 
height either h + 1 or h. i.e., a difference by a factor of | or 0 15 a 
_ Ifa node is deleted from left subtree than the difference be™’ 

height is 2. 
For balancing the tree two rotations are required — 
(Right rotation corresponding to node p. 
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Double Rotate 
Right Around m= 


Fig. 5.9 Deletion from an AVL Tree 


Q.11. Explain the concept of height balanced trees with their ‘Operation, 
(R.GRK, Dec. 2019 
Ans. Refer to Q.6, Q.7, Q.8 and Q.10. 
Q.12. Explain 2-3 trees with examples. 
Or 
Explain 2-3 trees with the help of suitable example. 
(R.GP.V., June 2014, Dec. 2014, 2013 
Or 
Write a short note on 2-3 tree. (R.GPV., Dec. 2h 
Ans. A 2-3 (or 3-2) tree is a tree in which each vertex, except leaf, bis! 
or 3 sons and one or two keys per node, and every path from the root io 
is of the same length. 
The tree consisting of a single vertex is a 2-3 tree. Fig. 5.10 shows it 
two 2-3 trees with six leaves. 


@) 
() @ ©. 
OO OO OO OO 
‘a) 


( 


(R.GPRYV, Dec. 201) 


Q 
O OO 


() 
Fig. 5.10 2-3 Trees 


of height h. The number of vertices of Ts 
—D/2, and the number of leaves is betwee? 


Let T be a 2-3 tree wt 


2™11) and (3h+1 
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ite short note on B-tree, 
13. Write 2018, Nov. 2018) 


; (R.GRY, May 

«, B-tree of order M is an M-way tree in which 

(i) All leaves are on the same level, 

(ii) All internal nodes except the root hay 

and at least (M/2) (nonempty) children, 
ii) The number of keys in each internal node 
amber of its children in the fashion of a search tree, 

7 . 

nl (iv) The root has atmost M children, but may have as few as 2 if it is 

ptaleft, or none, if the tree consists of the root alone, 


For example, fig. 5. 1 shows a B-tree of order 5, as here all leaves are on 
ame level and it also satisfies all other conditions of B-tree, 


© atmost M (nonempty) 


ildren 
is one less than 


Fig. 5.11 A B-tree of Order 5 


While fig. 5.12 does not show a B-tree. 
As in fig. 5.12 some nodes have empty children, and the leaves are not all 
onthe same level. While fig. 5.11 is a B-tree of order 5 whose keys are the 26 


fat Kiters of the alphabet. 


In Fig. 5.12 A 5-way Search Tree 
i rs 
M tet 70) LE. Hopcroft invented 2-3 trees, @ precu pee ee 


or to B-trees and 2- 


tee © iN Which internal node has either two ‘ ~ 
Were introduced by Bayer and McCreight in 1972 [18]; they did not 
"Phin their ao y Bay 
©ir choice of name. 
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Q.14. What are 2-3 trees and B-trees ? Explain me example 
nk, 
Ans. Refer to Q.12 and Q.13. » June My 


Q.15. Define B-trees. Prove that ifn 2 1, then for any rkey, 3 
height h and minimum degreet >2,h Slog, {n+ DY}. ary, Des 
Ans, B-trees — Refer to Q.13. MN) 
Proof — If a B-tree has height h, the number of its Nodes ig min 
when the root contains one key and all other nodes contain t — 1 isan 
case, there are 2 nodes at depth 1, 2t nodes at depth 2, 212 nodes at ‘ Inthig 
and so on, until at depth h there are 2t~! nodes, Fig. 5.13 shows sich th 3, 
for h = 3. Thus, the number n of keys satisfies the inequality, Oty 


1+2(t-1) 


h 
n21+(t-1) Sad 
i=] 
which implies the theorem. 
Root[T] 


Fig. 5.13 A B-tree of Height 3 Containing a Minimum 
Possible Number of Keys 


2.16. What is a B-tree ? Write down the properties of a B-tree. Mlustrate 


your answer with an example. (R.GRV., June 2017) 


Ans. Refer to Q.13. in 

Order — Order of B-tree defined as the minimum number of keys" 
non-root node (i.e., (n — 1)/2). 

Degree — Degree of B-tree is the maximum number of sons (it» J) 


sacl ot , Unit-V agg 

ey and an associated pointer (disk block number of Wha 

peo? ate data record. This means that One data file 
i ppt ving an ordering by a different key fig) 
in 


ever 
Could have pal! 


d, Something highly 


. Since 


each gi 
sch nalysis — Consider a B-tree (of order ™) of height h, 
has degree at most m, then the tree has at most im! leaves, 
nod! contains at least one key, this Means that n> m!, We faa be 
ah a tant, so the height of the tree is given asymptotically by * 
00 


eis 


Ign 
h < log, n= Igm © Oe) 


sti . Even in the worst : 
| is very small as m gets large. M st case (excluding the 
Pa essentially is splitting m/2 ways, implying that 
C 


Ign 
=> €0 
h < logim) 2 ig (m/2) € O(log n) 
Thus, the height of the tree is O(log n) in either case. For example, ifm 
2156 we can store 100,000 records with a height of only three. This is 
ingortant, since disk accesses are typically many orders of magnitude slower 
tunmain memory accesses, it is important to minimize the number of accesses, 


0.18. How multiway search is different from binary search tree? 
(R.GPV, Dec. 2016) 


4ns. Difference between multiway search tree and binary search tree are 


8 follows — 
Binary Search Tree 


It is a tree data structure with 
each of its node can hold at most 
2 branches. 

A node of binary search tree 22 
store only one key: 
«ary search tree 
be} have atmost 


M-way Search Tree 


) | Itis a tree data structure with 
each of its node can hold at 


Most M branches. 

A node in M-way search tree 

can store more than one keys 
~ | keys), 

Ifa node in M-way search tree 


s having k keys, where k <M, 


Every node is 
if not empty th 


Example ~ Refer to Q.13. ot then that nod branches. 
: | Node ¢: two branches. 

O.17. What are B-trees ? Write down its properties. What isthe wal KL branches. eer 
B-tree ? What is the height of a B tree of order m? (R.GR¥, Ma 29 ? 

Ans. Refer to Q.13 and Q.16. Ans, tne Sertion can be done into a B-tree the root as it has 8 

A B-tree eRe rds are ‘steettion of a node i Bree grows inary search Be? 
Pe can be used as an index file. The actual data reco! + one fi? Ps ap atic that all | boron level. While be 

‘where on disk. When one looks up and finds a target key, wha t their leaves, Pe 


a 
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tion of a node is done into an empty node then 
d the process finishes. If we insert newnode int 


204 


If each time inse: We jug 


insert the new node and th¢ : ‘ 

node then this node splits in between from median. 2 fy 
This median goes in higher level and becomes new root of two ns 

ren 


that generated above. Both of these nodes are on same level, 
When a search is later made through the tree, therefore a compa. 
with the median key will serve to direct the search into the proper subtree 7" 
example suppose we have following set of keys to be inserted into q Bey 
a, g, f, b, k, dh, m,j,e 51,5 %, ¢ 1m, tu, p, ao 
We are inserting above set into a B-tree of order 5. 


(a) 4,8, f,6 (bh) k (o) d, h, m 

ees 

[aoa] [en] [ko] [aba el] fen i] [emer 
@ij (e) e, s,i,r 


@ohntu 


PGI) fe] Pr) Pes 


(h) p 

___ Fig. 5.14 Growth of a B-tree or Insertion into a B-tree 
Initially B-tree is empty. Insertion can be shown by fig. 5.14- " 
then ne @) | Ateach time when we insert a new node into an emp 
wnode is sorted with already present keys as shown by fig. 5.) ‘s 
Betree is is Be a new key k is added after adding 4 keys % et 

into two nod So above node is full, and on insertion of node ki 
‘Odes one having keys a, b and other one having keys g, ka" 


at median of whi a wait 
5.14 (b). Which go in higher level become new root of the tree 25 5 
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Gil) On adding @'it gets added to a, b resulting as a, b i 
and m, they get added with g and k resulting g, h k, Geuek 


h 
14 (c)- 
ig 5) purther when node j i it spl; 
(iv) Fu node j is added, it splits fro. fie a 
median gets attached to i, resulting in fig. 5.14 (d), m median i.e., j and 


| this (v) Further additions of, s, i, rdo not result in any splitting shown 
4 (e). 
in fig. 5-1 a . : 
in (vi) On addition x again a split takes place at median 1, shown in 
fg. 5:14 § 
(vii) Further c, j, n, t, u are added without any more splitting shown 
in fig. 5.14 (g)- 


(viii) When node p is added , again a split takes place at median m 
but now upper level is also full, so further breakage takes place at median dy 
resulting in j at one more higher level becomes new root of tree as shown in 
fig. 5.14 (h)- 

0.20. How can deletion be done from a B-tree ? Explain. 

Ans. For deleting an entry from a B-tree, we should always check whether 
the node from which an entry ’is to be deleted has minimum number of entries 
or not. 

If it has minimum number of entries then deletion is complete, otherwise 
we first look at the two leaves (or, in the case of a node on the outside, one 
leaf) that are immediately adjacent to each other and are children of the same 
node, If one of these has more than the minimum number of entries, then one 
of them can be moved into the parent node, and the entry from the parent 
moved into the leaf where the deletion is occurring. 

If finally, the adjacent leaf has only the minimum number of entries, then 
the two leaves and the maximum number of entries allowed. If this step leaves 
ie Parent node with too few entries, then the process propagates sen ra 
oe case, the last entry is removed from the root, and then . peg 
hy ie tree decreases. For example, the process of deletion in a B-t 

wn in fig. 5.15 (a). 


1. Delete h, x 


Promote s 


sand delete from 
leaf 
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2, Delete p: 


3. Delete d: 


Combine 


@h 


Tequired. So, hei 
shown in fig. 5, 


(i) r— 


Node havin, 


Temove success, 


(7) 
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Fig. 5.15 Deletion from a B-tree 


z ~ If we delete entry h from above B-tree of order 5, then it 
resulting node after deletion has 2 entry i.e., minimum number of ents 
leletion gets finished and no further action is required ® 


re di 
15 (a). 


Successor (s) or predece: 


& P has only two entries, 
Or s and replace r as shor 


a We delete entry r from the B-tree, then after deleti 
only one entry, i.e., less than minimum entries allowes 


ssor (p). 


so here removal is no! 
wn in fig. 5.15 (a). 


on the 
4,39 


+ allowed. Ve 
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++) p — For deleting p, the node after its deleti 
i s ion has onl: 
ss Kod es its successor Ss as its predecessor in n, cae 
wi 


9s? with s then node having s, hi is 
replace P § having s, has only one entry so again we 
Ewe yecessor of S, i.e., t resulting into a tree as shown in fig, 315 (b). 


x for § . 
{oo (iv) d- For deletion d, we have to replace it by c, but resulting node 


only one entry, i.e., f. So again we look for predecessor of ¢, ie., a, b. 
iS . e 
- deletion of b is also not possible, for this we combine two nodes 


Now, 4 sanctall : 
delete entry d resulting ina tree shown in fig. 5.15 (d). But here also nodes 
ant one entry f, i.e., less than minimum possible number. Again we 


pave only 


mbine three nodes resulting into a tree as shown in fig. 5.15 (e). 
cot 


NUMERICAL PROBLEMS 


Prob.1. Compare heap and binary search tree, Construct a heap and a 
binary search tree of the following data — 

44, 22, 77, 11, 66, 55, 33, 88, 99. (R.GP.V., Dec. 2013) 

Sol, Comparison between Binary Search Tree and Heap — Refer to Q.2. 

Construction of Heap — The construction of max-heap is shown in 


fig. 5.16. 


@ re @ 
® @a@™ ® & 
(1) 
(@) O) (7) @ 
| @ _ @ OQ, ~ 
se 
S® 6 6©6 6O®@ 
O) o 
7) © 
@) © (3) — @ (55) 
o S. 5a60 GOGO 
®@® @ 6 () 
@ 


() 
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(3) 
6 Q —- @ S 
6 @®ea ® OOH ®@ 
6 ® © © 
@ 


Fig. 5.16 


Creation of Binary Search Tree — The creation of bina 
as follows — 


© @ ) @ 
dd So 

@) @) @ 

(a) (b) (©) @ (e) 

(44) (4) G4) (4) 
am ©® (7) @) @ @ @ 
OM MA YOM ® OOOO 
(5) Gs) Gs) ©) @ 

oO @ (h) @ 


Fig. 5.17 


TY Search tree 


Prob.2. The post order traversal of a binary tree T is DFEBGLJKHCA 
and inorder traversal of T is DBFEAGCLJHK. Construct the binary tree 
and also writes the Step: 


's t0 construct the binary tree in postorder-inorier 
combination, 


Sol. The steps to Construct the binary tree in postorder-inorder combination 
are as follows — 


@ Postorder — 


DFEBGLJIKHCA 
Inorder  — 


DBFEAGCL JHK 

: Left subtree Right subtree jgthe 

stems Re Of a tree ig Visited at the last in postorder traversal. Hence, £ th 

roan hee ee Observing the inorder traversal, we see that the aa tree 
(i) © left subtree and nodes after A make right subtree of a binary - 

five ti) The root of left subtree ig found by the last node in the ap 


(R.GPY,, June 2019 | 


a 
al of left Subtree. That is B; Dis left child of B by observing the in 


nsists of F and B, Again E is the Toot of 
trave’ tree in postor 
his traversal. 


(iii) The root of right subtree is found by 
fast node in the postorder traversal of Tight 
the e. That is C; G is the left child of C by 
cicieac g the inorder traversal and the Tight 
oes of C consists of L, J, H and K, Again H 
sul he root of this subtree in postorder traversal 
a K is the right child of H by observing the 
ae traversal and left subtree of H consists 
aan J. Again J is the root of this subtree in 
 onded traversal and L is the left child of J by 
Peerving the inorder traversal. 


The constructed binary tree is shown in fig. 5.18. 


Prob.3. A binary tree T has 9 nodes the inorder and preorder traversal 
of T yield the following sequence of nodes — 
Inorder -EACKFHDBG 
Preorder—-FAEKCDHGB 
Draw the tree T, 


Sol. The steps to construct the 

combination are as follows — 
(i) Preorder -FAEKC DHGB 
Inorder — EACK ti HDBG 
LER Root node Right 

Since, in preorder traversal the first node is the root node. Hence F is the 
node of the given binary tree. 

Now from the given inorder traversal we conclude that nodes before F 
make a left subtree and the nodes after F make the right subtree. , 
(ii) On considering the left subtree EAC K, the root will be ‘Aas A 
Sccurs first in Preorder traversal as compared to E, C and K nodes. Similarly 
iS ©Ompared to the above process, E makes a 


lett Subtree and the nodes after A make the right 
Subtree, 


the 


(R.GPY¥, Dec. 2017) 
binary tree in preorder and inorder 


Toot 


Gil) On comparing the right sub-tree, 
Node will be ‘D’ as it occurs first in 
traversal as compared to H, B and G. 
© nodes before D make the left subtree 
© odes after D make the right subtree. 
the bi aes following the same process we obtain 
"MALY tree ag shown in fig. 5.19. 


Toot 
Tder 


nce ¢ 
ang h 
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the following list {5, 6, 

, Construct an A VL tree for f ; 6,8, 3 

— ie elements successively, starting with empty tree, 44, 7 
ig (RGR, June 2008, Dee _ 


i 2% 
Sol. The construction of AVL tree is as follows — 4) 
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by inse 


® 
ee © 

(a) 
c Fig. 5.20 


Prob.5. Compare AVL trees with binary 
keys into an AVL tree — 


28, 32, 12, 5, 84, 53, 91, 35, 3,11 (RGRY, Dee. 2011) 
Sol. Comparison — Refer to Q.1 and Q.6, 


Fig. 5.21 shows the insertion of given keys into an AVL tree, 
—- Q 
=| 0 
@ ‘@ @@ 
© 0 0 t) o 0 
Q @O® © 


(a) Insert 28 (b) Insert 32 (c) Insert12  (d) Insert5 —_(e) Insert 84 


Search trees. Insert the following 


( 


ithm (B.E., 1V-Sem.) 
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o ence of elements into an Avy, 
. the following sequ 
Prob.6. (i) Insert 


tree 
it tree — 
starting with an rege’ eameun 


Delete 30 in the AVL tree that you got and re-balance hee 
(ii) Dele! 


; (RGPRY, Nov, 24 
(if required). tide” : 
Sol. (i) The construction of AVL . 

RL, (1s) 
y 9 
© @ 
0 
(a) Insert 10 (b) Insert 20 (Oiieweis 
QQ mw, 


(h) Insert 19 


Unit-V 23 
(ii) Delete 30 ~ 


@) Delete 30 
Fig. 5.22 
Prob.7. Obtain height balanced trees sta 
following set of instructions — 
fi Dec, Jan, Apr, Mar, Jul, Aug, Oct, Feb, Nov, May, June. 
(R.GRY, Dec. 2008, June 2011, Dec. 2014) 
Sol. Fig. 5.23 shows the creation of height balanced tree (also called AVL tree), 


ting with empty tree on the 


=> e 0 
Dec 
(@) 
Jan__, Apr 
=i § 


(6) A) i 
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Aug 


(B.E., IV-Sem.) 


@ 
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e Fig. 5.23 
starti rob. 8 Define height balance tree. Construct a height balance tree 
ing with empty tree on the following data — 
Dec, Jan, Apr, Mar, Jul, Aug, Oct, Feb, Nov, May, Jun. 
Ss (R.GB¥., Dec. 2013) 
ne Height Balance Tree — Refer to Q.6. 
roblem — Refer to Prob.7. 
Prob.9. Insert the elements in the order shown below to build into an 


F - tree. Also determine the complexity of this procedure 1, 26,2, 25,3, 24, 
» 23, 5, 22; 6, (R.GBV., June 2014, Dec. 2015) 


Sol. The construction of AVL tree is as follows — 


216 Analysis & Design of Algorithm (B.E., 1V-Sem.) 


Insert 1— Insert 26— Insert 2- 
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Fig. 5.24 

Prob.10. Create a B-tree of order 5 from the following list of ‘data items — 
30, 20, 35, 95, 15, 60, 55, 25, 5, 65, 70, 10, 40, 50, 80, 45. 

(R.GBYV., June 2010) 


Sol. The order of given B-tree is 5. 


(i) Insert 30 — 
(ii) Insert 20 — 
(iii) Insert 35 — 
(iv) Insert 95 — 
(v) Insert 15 — [30] 
[s]20] [ss]9s} 
(vi) Insert 60 — [30] 
[s]20] Ls] oof9s] 
[30] 


(vii) Insert 55 — 


@ 
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(viii) Insert 25 — [30] 
[s]20]25] [3s[ssToo]os] 
(ix) Insert 5 — 
Ls [1s] 20]25] Bs [ss] oops] 
(x) Insert 65 — [30] 60] 


(xi) Insert 70 — 


(xii) Insert 10 — 


(xiii) Insert 40 — 


(xiv) Insert 50 — 


(xv) Insert 80 — 


(xvi) Insert 45 — 


Prob.11. Define B-tre. 
P tree. Insert th je i aad 
an initially empty B-tree Of order 4, ‘hil ceeds inl ; 
1,5, 6,2, 8, I, 13, 18, 20, 7,9 
Sol. B-tree — Refer to Q.13, 


Insertion O . 
peration — 
can accommodate th une 


(R.GRY, Dec. 2012) 


ich 
first value 1 is placed in a new node Ls 
© next two values also Le., 
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Fig. 5.26 (a) 


when the fourth value 2 is to be added, the node i 
5 into leaf nodes with a parent at 5, : 


© 
AD 6 
Fig. 5.26 (b) 
The following item 8 is to be addeéd ina leafnode. A search for its appropriate 


place puts it in the node containing 6. Next, 11 is also put in the same. So we have 


C52 
C422 G8iD 


Fig. 5.26 (c) 
Now 13 is to be added. But the right leaf node is full. Therefore, it is split 
at median value 8 and thus it moves up to the parent. Also it splits up to make 
two nodes. So we have 


is split at a median value 


Cs 8 
S122 © Cam 
Fig. 5.26 (d) 
The remaining items may also be added following the above procedure. 


The final result is 
Ga 
C412) GETS Gon Gi8209 


Fig. 5.26 (e) 


Prob.12. Create a B-tree for the following list of elements — 
- L = {86, 50, 40, 3, 94, 10, 70, 90, 110, ped . 4 i 
Sten minimizatic ‘tor t= 3, minimum degree = 2 and maximum degree = 5. 
Te ae (R.GPV., Dec. 2008, June 2013, 2014) 
Sol. The order of B-tree is 5. So maximum permitted data items are 
5~1=4 and minimum data item at nonroot node should be (5 — 1)/2 = 2. 


Now we start constructing B-tree by inserting elements one by one. 


0 
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(iii) 40 5086 (iv) |]3 4050 = 
Promote 


(vy) |3 40 86 94 


Here, the number of items exceeds maximum permitted limited, so break the 


220 Al 


node. s 
(vi) [ 50 | (vii) Te] 
pa oe 
(viii) [ so | (ix) a] 


Ps] Eo a] 
” = 
Promote 


Fig. 5.27 


Pre en 3. Create a B-tree of order 5 for the following data items - 
| H, K, J, B, P, O, E, A, S, W, T, CL, N, ¥, M. “ 
(R.GPV, Dec. ? 


Sol. The order of given B-tree is 5. 


P] 


(i) Insert D— ; 
(ii) Insert H— 
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i) Insert K— (iv) Insert J 
rn) Insert B— 
i) Insert P — 


| 


(xi) Insert W— fu] | 
PPer] EE) cE 
[Te | 


(vii) Insert Q— 


BHRORE 
gi 
‘d 
| 


(viii) Insert E— 


(x) Insert A — 


(ii) Insert T— 


is i it .E., 1V-Sem., 
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(xiii) Insert C— 


Prob.14, Construct a B-tree of order 3 for the following set of input data- 
69, 19, 43, 16, 25, 40, 132, 100, 145, 7, 15, 18. 
(R.GP.V., Dec. 2016) 


Sol. 
a 
je] = [a] 
CEET] fl nn 
ony ct opel fl 
Bey ee PAE EEE 


vf ; 3 
(@ Insert 69 (yy Insert 19 (c) Insert 43 @ Insert I uaa ake 


of Algorithm (B.E., 1V-Sem.) 
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(D) Insert 18 
Fig. 5.29 


| BASIC SEARCH AND TRAVERSAL TECHNIQUES FOR TREES 
if IND GRAPHS (INORDER, PREORDER, POSTORDER, FS, 
L BFS), NP-COMPLETENESS. 


2.21. Write short note on tree traversals. (RGR, May 2019) 


Ans, Tree traversal is one of the most common operations on Ho 
Structures, It is a way in which each node in the tree is visited exactly 00°?” 
@ systematic manner. 

‘ we rening trees, once we start from the root, there nea wo 
ae a a - a right. Ata given node, there are three things 3 avers? ; 
right mblise be nodeistself, to traverse its left subtree and te si on 
erates ebending on whether we traverse the node its? 

8 either subtree, between the subtrees or after traversing bo af 
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re are many traversal orders. If root, left subtree and right 
, j subt 
gesignated by R’, L, R respectively, then the possible comedies ate ie 
R'LR,RRL,LRR,LRR, RLRY RRL : 
But conventionally, it is desirable to traverse 


the left 
sight subtree. Therefore, the three standard travers; See etm ts 


al orders are — 
(i) Preorder Traversal (R'LR) ~1f the root node is visi 
aversing its subtrees, it is called the preorder traversal, epee 
(ii) Postorder. Traversal (LRR)) — If the root node is visited after 
aversing its subtrees, it is called the postorder traversal, 
(iii) Inorder Traversal (LR' R)—If the root node is visited in between 
the subtrees, it is called the inorder traversal. 
0.22. Write and explain inorder traversal algorithm. 
Ans. Algorithm for inorder traversal is given as follows — 


Algorithm 5.6 Inorder Traversal 
treenode = record 


Type data; // Type is the data type of data. 
treenode *Ichild; treenode *rchild; 


} 

1. Algorithm InOrder(t) 

2. //tis a binary tree. Each node of t has 
3. // their fields: Ichild, data and rchild. 
4. { 

5 if t + 0 then 

6 

vf 

8. 


{ 
InOrder (t — Ichild); 
. Visit(t); 
5. InOrder(t > rchild); 
10. } 


Nl. } 
Here, left child of a node is denoted by Ichild, right child is denoted by 
hild and the node to be visited is denoted by treenode. : 
In this algorithm left node of a child is traversed first then the root node is 
Visited and finally the right child of node is traversed. Steps to be followed in this 
Of traversal are — . oa 
(i) Traverse the left subtree of R in inorder. 
Gi) Process the root R. a 
(iii) Traverse the right subtree of R in inorder. 


226 Analysis & Design of Algorithm (B.E., 1V-Sem.) 


inorder traversal in fig. 5.30 can be shown as follows _ 
~Start 


For example, 


Fig. 5.30 Inorder Traversal of a Tree 

Inorder traversal is, 

DBFEAGCLJHK 

Explanation — In this traversal first traversing starts from root node i, 
node A. We visit first leftchild of root node i.e., node B. 

Further we process leftchild of node B, before traversing node B ic,, 
node D. As node D does not have any children, so it is executed first, After 
executing left child node itself is executed so we process node B. After visiting 
node, rightchild of node is visited i.e., node E. 

But before executing node E, its left child has to be executed i.e., node F. 

After executing leftchild node E is executed. Now left subtree of nodeA 
is fully executed, we visit node A. 

After executing node A right subtree of node A is visited in same manner. 


9.23. Write and explain preorder traversal algorithm. , 
Ans, In preorder traversal (DLR), first the root is visited, then left child 
of node is visited and then rightchild of node is visited. 
Steps to be followed in this traversal are as follows — 
10) Process the root R. 
ii) Traverse the left subtree of R in preorder. 
(ii) Traverse the right subtree of R in preorder. 
Algorithm is given in algorithm 5.7. 
Algorithm 5.7 Preorder Traversal 
1. Algorithm PreOrder(t) 
= /tis a binary tree, Each node of t has 
- Wl three fields: Ichild, data and rchild. 
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4 
5 if t #0 then 
6. { 
7 Visit(t); 
8. PreOrder(t = Ichild); 
9. PreOrder(t + rchild); 
10. } 


ll. } 
Preorder traversal for fig. 5.31 can be shown as — 
A, B, D, E, B,C, GH, J, LK. 


Start 


Fig. 5.31 Preorder Traversal a Tree 


_ Explanation — In this traversal, traversing starts from root node of tree 
le., A. First we process the.node then its leftchild so, first of all node A is 
Processed. After that left child of node A is to be visited so, here we traverse 
leftchild of A ie., B. After processing B, leftchild of B i.e., node D is processed 
88 we do not have any children of D so, we proceed to rightchild of node B 
me node E, Process node E and visit leftchild of node E i.e., node F. Here, 
‘gain we do not have any children of node F. So, we proceed towards rightchild 
°fnode E. But rightchild of E is empty subtree so we process right subtree of 
Node A. Right subtree of node A has root C. 

So, node C is processed, and we move to leftchild of node C i.e., node G. 
Node G does not have any children, so after processing node G, we go for 
ihtchita of node C i.e. node H. We proceed node H and proceed towards 
fichild of node H i.e., node J. 4 

Here, node J is processed and then leftchild of J i.e., node L is processed. 
And finally we visit rightchild of node H ic. node K. 


| 


| 


228 Analysis & Design of Algorithm (B.E., 1V-Sem.) 


0.24. Write and explain postorder traversal algorithm. 


Ans. In postorder traversal (LRD), first of all the leftchilq of n 


visited, then the rightchild of node is visited and finally the node itse} 
Steps to be followed in this type of traversal are as follows — 
(i) Traverse the leftsubtree of R in postorder, 
(ii) Traverse the right subtree of R in postorder, 
(iii) Process the root R. 
Algorithm for this type of traversal can be given as follows — 


Algorithm 5.8 Postorder Traversal 


1. Algorithm PostOrder(t) 

2. //tis a binary tree. Each node of t has 
3. // three fields: /child, data and rchild. 
4. { 

5. if t + 0 then 

6 { 

7. PostOrder(t > Ichild); 

8. PostOrder(t — rchild); 

9. Visit(t); 

10. } 

Th. } 


Postorder traversal for fig. 5.32 can be shown as follows — 


Fig. 5.32 Postorder Traversal a Tree 
Post order — 


DE E,B,GLJ,K,H,CA 


fis 


de jg 
Visited, 
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Explanation — For the postorder traversal first we process leftchild of 
a 


pode B i.e. node D of node B. 


Further, left child of node E i.e., node F ji 
and B are processed. Now right subtree of eA otha es a 
Gis processed first, then nodes L, J, K, H, C and Aare processed se 

Each traversal can be regarded as a walk through the binary tree. Duri 
this walk, each node is reached three times — once from its parent, acne 
returning its left subtree, and once on returning from its right subtree. In each 
of these three times a constant amount of work is done, so the total time taken 
by the traversal is 0(n). The only additional space needed is that for the recursion 
stack. If t has depth d, then this space is 6(d). For an n-node binary tree, d < 
nand so S(n) = O(n). 

0.25. Define preorder, inorder and postorder traversal. Also explain in 
detail all the traversals. (R.GPV., June 2015) 

Ans. Refer to Q.23, Q.22 and Q.24. 


0.26. Illustrate the inorder, preorder and postorder traversals for the 
following binary search tree. 


(R.GBV¥., Nov. 2018) 
Ans. (i) Inorder —4, 10, 12, 15, 18, 22, 24, 25, 31, 35, 44, 50, 66, 70, 90. 
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6 (ii) Preorder — 25, 15, 10, 4, 12, 22, 18, 24, 50, 35, 31, 44,70, ‘ 


Fig. 5.35 


ii) Postorder —4, 12, 10, 18, 24, 
a (iii) Postorder 8, 24, 22, 15,31, 44, 35, 66, 90, 70, 50, 


Fig. 5.36 
0.27. Show preorder, inorder and postorder for the following tree — 


(A) 


(2) © 
(c) © 
© © 


Fig. 5.37 
Ans. (i) Preorder~ABCDEFG 
(ii) Inorder-D CEB FAG 
(iii) Postorder — DECFBGA 


(R.GRYV., June 2017) 
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0.28. Describe the graph traversal techniques, 
Or 

Write short note on graph traversal, 


Ans. In many problems, we like to investigate ioee 3 
some systematic order, just as with binary Pg aa pe i 
tematic traversal methods. Generally in tree traversal, we had stot ibe 
with which we started; in graphs, we often do not have any one Vertex sin a 
out as special, and therefore the traversal may start at an arbitrary ne 
Although there are many possible orders for visiting the vertices of the gray h, 
two methods are of particular importance. There are two traversal siclinianee 
in graphs — 

(i) Depth-first Traversal Depth-first traversal of a graph is roughly 
similar to preorder traversal of an ordered tree. Suppose that the traversal has 
just arrived a vertex V, and suppose wy, w2, Wy be the vertices adjacent 
to V. Then we shall next visit w; and keep Wa, ...., W, waiting. After visiting 
Wj, We traverse all the vertices to which it is adjacent before returning to 
traverse W2, ..., Wk. 

(ii) Breadth-first Traversal — This traversal of a graph is roughly 
similar to level-by-level traversal of an ordered tree. If the traversal has just 
visited a vertex V, then it next visits all the vertices adjacent to V, putting the 
vertices adjacent to these in a waiting list to be traversed after all vertices 
adjacent to V have been visited. Fig. 5.38 explains the order of visiting the 


(R.GRY, Dec. 201 ”/) 


vertices of one graph under both depth-first and breadth-first traversals. 


et oe 
‘a-o-© ‘Q-0-0 
NS © OPO 
Soo £00 
Det eel 


Fig. 5.38 Graph Traversal 
2.29. Compare DFS and BFS. (R.GRY, June — May 2018) 
Ans, json between DFS and BFS is given below ~ 
a ante search start vertex V is visited first - it Ma 
; i j rtex Wy is visited next. 
7 ae Saga a Rasch ited tn depth first manner 


it . : visi 
Visiting w, all the vertices adjacent to wi ar 
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before returning to traverse Why es Wke While breadth first Search 
to level-by-level traversing of an ordered tree. 

(ii) Depth first search is similar to preorder traversal of a, 
tree, while breadth first search is similar to inorder traversal, 

(ii) Depth first search uses a stack to hold nodes that are 
be processed, while breadth first search uses a queue. 


is Similar 
n Ordereg 


Waiting to 


0.30. Write any two data structures that are suitable for representiy 
graph. Write an algorithm for depth first traversal of a graph using it 5 
your two data structures. (RGR, Dec, 2019 


Ans. Graph can be represented by using an array or linked list, 
(i) Array Representation of Graph — The nature of arra 
representation of a graph is sequential, because vertices are stored sequential] 
in it. Graph implementation requires a one-dimensional array to store data re 


a two-dimensional array to store its connectivity with other data, Generally, 
two-dimensional array represents the adjacency matrix. ‘ 


(a) Graph (b) 1-D Representation _(c) 2-D Representation 
Fig. 5.39 Array Representation of Graph 


The syntax to implement graph using array is — 
Struct graph 
{ 


char V[max]; 


: // vertex implementation 
int e[{max] [max]; 


//edge implementation 


(i) Linked List Representation of a Graph — The linked list 
Tepresentation of a graph is also termed as adjacency structure. 
Linked representation of graph in fig. 5.39 (a) is shown in fig. 5.40. 


Head Node 
Ta 74 
LE 
a [ [++—{s 
Fig. 5.40 Link Ll —-C 


ed List Representation of Graph in Fig. 5.39) 
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Algorithm of Depth First Traversal (When Graph is Represented 


eg Linked List) — 
Algorithm LDFT (head, visited{n]) 


sil 


* This algorithm uses linked list havi 

ei list is the representation of graph He we “ost tem 
which traversal starts and visited is an integer or boolean array of size x 
where, n is the number of vertices in graph. Initially all the values of visited{ ] is 

0*/ 

Initialize pointer P=head; 

print(head —> data); 

visited [head] = 1; 

while (P > link is not NULL) do 

P=P = link; 

if (visited [P] = 0) then 

call LDFT (P, visited); 
end while 
end LDFT 


0.31. Write down the algorithm of BFS and DFS of a tree. How do you 
maintain the open and closed list in the algorithm if the nodes which are 
explored and whose children has not been generated will be in the open list 
and the nodes which are explored and whose children has been generated in 
the closed list ? Taking suitable example of tree, explain these list 
manipulations in BFS and DFS algorithms. 


Or 
Write an algorithm for BFS and DFS. (R.GBV., Dec. 2009) 

Or 
What is BFS and DFS ? Explain with suitable example with respect to 
tree, (R.GPV., Dec. 2015) 


Ans. Breadth-first Search — Breadth-first Search explores the space 
level by level only when there are no more states to be explored at a given level 
does the algorithm move on to the next level. 

We implement BFS using lists open & closed to keep track of progress 

ough the state space. In the open list, the elements will be, who have been 
&nerated but whose children has not been examined. Closed list records the 


°tder of removing the states from open list will be the order of searching. 
Den is Reais as queue on first in first out data structure. States are 
dded to the right of the list and removed from the left. 
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The algorithm for Breadth-first search procedure is as follows — 


Algorithm 5.9 Breadth-first-Search 


begin 
open = [start] ; 
closed = [] 5 
while open # [] do 
begin P 
remove leftmost state from open call it x ; 
if x is a goal then return success 
else 
begin 
generate children of x ; 
put x on closed ; 
put children on right end of open ; 
end 
end 
return (failure) 
end 
Depth-first Search — In depth first search when a state is examined all of 
its children and their descendants are examined before any of its siblings. Depth 
first search goes deeper into the search space whenever this is possible, only 
when no further descendants of a state can be found, are its siblings considered. 
The algorithm for Depth-first search is as follows — 
Algorithm 5.10 Depth-first Search 
begin 
open = [start] ; 
closed = [] ; 
while open # [ ] do 
begin 
remove left most state from open call it x ; 


if x is a goal then return success 
else 


begin 
generate children of x : 
put x on closed ; 


put children on left end F 
ea end of open ; 


end 
Teturn (failure) 
end. 
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For example, consider the tree shown in fi 


: : ig- 5.41. Here the path 
BFS is shown by dotted lines, Fig. 5.41 explains BFS proc: ‘ra 


Fig. 5.41 Breadth-first Search 
The open and closed lists maintained by BFS are shown below — 


open = [A] ; closed = [ ] 
open = [B, E] ; closed = [A] 
open = [E, C, H] ; closed = [A, B] 


open = [C, H, F, G] ; closed =[A, B, E] 

open = [H, F, G, D]; closed =[A, B, E, C] 

open = [F,GD,I]; closed =[A, B, E, C, H] 
open = [G,D,1, J]; closed =[A, B, E, C, H, F] 
open =[D,1I,J.K]; closed=[A, B, E, C, H, F, G] 
open = [I, J, K] ; closed = [A, B, E, C, H, F, G D] 


open = [J, K] ; closed = [A, B, E, C, H, F, G D, I] 
open = [k] ; closed = [A, B, E, C, H, F, GD, I, J] 
open =[]; closed = [A, B, E, C, H, F, G D, I, J, K] 


To understand DFS, consider the tree below. Here dotted lines show the 


ih followed by DFS. Fig. 5.42 explains DFS procedure. 


Fig. 5.42 Depth-first Search 
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The open and closed list maintained by DFS is shown below — 
open = [A] ; closed = [] 
open = [B, C) closed = [A] 
open = [D, E, C]; closed = [A, B] 
open = [H, 1, E, C]; closed = [A, B, D] 
open = [I, E, (oi closed = [A, B, D, H] 
open = [E, C] ; closed = [A, B, D, H, I] 
open = [J, C] closed = [A, B, D, H, 1, E] 
open = [C] ; closed = [A, B, D, H, I, E, J] 
open = [F, G] ; closed = [A, B, D, H, 1, E, J, C] 
open = [K, G] ; closed = [A, B, D, H, I, E, J, C, F] 
open = [G] ; closed = [A, B, D, H, I, E, J, C, F, K] 
open = [L] ; closed = [A, B, D, H, I, E, J, C, F, K, G] 
open =[]; closed = [A, B, D, H, I, E,J,C,,K, GL] 


0.32. List out the techniques for traversals in graph. Also explain each 
in detail with its procedure. (R.GRY., June 2015) 


Ans. Refer to Q.28 and Q.31. 


0.33. Write BFS algorithm and analyse the running time of algorithm. 
(R.GP.V., Dec. 2008, 2010) 

Ans. BFS Algorithm — Refer to Q.31. 

Analysis of Running Time— After in itialization, each vertex is enqueued 
at most once, and hence dequeued at most once. The operations of enqueuing 
and dequeuing take O(1) time, so the total time devoted to queue operationsis 
O(v). Because the adjacency list of each vertex is scanned only when the 
vertex is dequeued, the adjacency list of each vertex is scanned at most once. 
Since the sum of the lengths of all the adjacency lists is Q(B), at most of) 
time is spent in total scanning adjacency lists. The overhead for initialization 
O(v), and thus the total running time of BFS is O(V + E). Thus, breadth-firt 
search runs in time linear in the size of the adjacency list representation of 


0.34. Write DFS algorithm and calculate the running time of it. 1) 
(R.GBV., Dec. 20 


Ans. DFS Algorithm — Refer to Q.31. «for 
_ Running Time of DFS — A depth first traversal takes ONE) ig 
adjacency list representation and O(N?) for matrix representation. ing 
ni 
_ 935. Write BFS and DFS algorithms and also analyse ww) 
time of algorithm. (R.GPV., June eM 
Ans. BFS and DFS Algorithm — Refer to Q.31. 
Running Time of BFS — Refer to Q.33. 
Running Time of DFS — Refer to Q.34. 
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0. a Starting from vertex V, apply BFS and DFS in the given ahead 
fi 54 


v3 Vg 
Td 
v4 
Vs Vo 
Fig. 5.43 


(R.GP.V., June 2010) 
Ans. BFS for the fig. 5,43 is given by — 
V4 V3 V6 V2 Vi Vs V7 Vo Va 
DFS for the given fig. 5.43 is — 
V4 V6 Vi V7 Vs Vo Vs V2 V3 
0.37. Explain undecidable problem. (R.GPV., June 2015) 
Ans. An undecidable problem is a problem for which there is no algorithm 
that can solve it. Alan Turing proved that the famous halting problem is 
undecidable. The halting problem can be simply stated as follows — Given an 
input and a Turing machine, there is no algorithm to determine if the machine 


will eventually halt. There are several problems in mathematics and computer 
science that are undecidable. 


Q.38. Discuss polynomial and non-polynomial time algorithms. 
(R.GBV., June 2016) 
Ans. If the complexity of an algorithm is expressed as O(p(n)) where 
P(n) is some polynomial of n, then the algorithm is said to be a polynomial time 
algorithm. Generally, polynomial time algorithms are tractable. Any algorithm 
with a time complexity that cannot be bounded by such bound, is called a non- 
polynomial time algorithms. 


0.39, What are deterministic and non-deterministic algorithms ? How 
these can be used to explain NP-completeness and NP-hardness ? 
(R.GP.V., June 2007) 
Ans, Algorithms with the property that the result of every operation is 
Uniquely defined, are termed deterministic algorithms. In a theoretical 
framework, we can remove this restriction on the outcome of every operation. 
We can allow algorithms to contain operations whose outcomes are not uniquely 
defined but are limited to specified sets of possibilities. The machine executing 
Such operations is allowed to choose any one'of these outcomes subject to a 
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ndition to be defined later. This leads to the — 

algorithm. Three new functions specify such alga ofa 
Ms ~ 

et § 


termination co 
nondeterministic ‘ 
(Choice (S) arbitrarily chooses one of the elements Of 5, 
(ii) Failure() signals an unsuccessful completion, 
(iii) Success( ) signals a successful completion, 

The assignment statement x: = Choice (1, n) could result in x being 
any one of the integers in the range [1, n]. There is no rule Specifying how thi 
choice is to be made. The Failure( ) and Success( ) signals are used tod fe 
a computation of the algorithm. These statements cannot be used to < fe ine 
return. Whenever there is a set of choices that leads to a successful complet, a 
then one such set of choices is always made and the algorithm feriiaas! 
successfully. A nondeterministic algorithm terminates unsuccessfully ifand 
only if there exists no set of choices leading to a success signal. The computin, 
times for Choice, Success and Failure are taken to be O(1). A machine capita 
of executing a nondeterministic algorithm in this way is called 4 
nondeterministic machine. 


0.40. Define P and NP problems. 
Or 


Assigned 


Explain class P problem. (R.GP.V., June 2015) 


Ans. P is the set of all decision problems solvable by deterministic 
algorithms in polynomial time. NP is the set of all decision problems solvable 
by non-deterministic algorithms in polynomial time. 

Q.41. Prove that P —NP. 

Ans. Since deterministic algorithms are just a 
special case of nondeterministic ones, so we conclude 
that Pc NP. Fig. 5.44 displays the relationship between 
P and NP assuming that P + NP. 
a3 The language verified by a verification algorithm 

is 

L= {x © {0, 1}*; There exists y € {0, 1}* 
such that A (x, y) = 1} 
ifLeP, then Le NB, since if there isa polynomial-time algorithm to decide - 
the algorithm can be easily converted to a two argument verification algo! it 
that simply ignores any certificate and accepts exactly those input s 
determines to be in L. Thus, PNP. 


Fig. 5.4 


; yy suitable 
9.42. What is P, NP class problems ? Explain the concept with 01d) 


example. (R.GPV., June 2014; 
Ans. Refer to Q.40 and Q.41. 
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9.43. Whatis the relationship between NP-hard and. NP-complete classes ? 
Or 


Explain NP-hard problems. (R.GRY¥., June 2015) 


Ans. A problem L is NP-hard if and only if satisfiability reduce to L 
(satisfiability cc L). A problem is NP-complete if and only if Lis NP-hard and 
Le NP. 

Only a decision problem can be NP- NP 
complete. However, an optimization problem 
may be NP-hard. Furthermore if L; is a 
decision problem and L, an optimization 
problem, then it is possible that L, « L,. 

One can trivially show that the Knapsack p 

decision problem reduces to the Knapsack 7 
optimization problem. For the clique problem Fig. 5.45 

one can easily show that the clique decision problem reduces to the clique 
optimization problem. In fact, one can also show that these optimization 
problems reduce to their corresponding decision problems. Fig. 5.45 shows 
the relationship among these classes. 


0.44. Discuss the relationship between class P, NP, NP-complete and 
NP-hard problems with example of each class. 
(R.GRV., Dec. 2008, June 2009, Dec. 2011, 2015) 
Or 
Discuss the relationship between P, NP, NP-complete and NP-hard 
Problems. (R.GP.V., June 2015) 


Ans. Refer to Q.40, Q.41 and Q.43. 


0.45, Write short note on NP-completeness. 
(R.GR.V., Dec. 2006, 2007, June 2017, Nov. 2018, May 2019) 
Or 
Explain NP-completeness briefly. 
Or 
Explain NP-completeness with example. 
Or 
Write a short note on NP-completeness problem. (R.GP.V., Dec. 2016) 
Or 
Discuss in detail NP-complete problem with example. 
(R.GPM., May 2018) 
Ans. Polynomial-time reductions provide a formal means for showing 
that one problem is at least as hard as another, within a polynomial-time factor. 


NP-complete 


NP-hard 


(R.GR.V. June 2009) 


(R.GR¥,, Dec. 2013) 
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<p Ly, then Ly is not more than a polynomial fact 


vi fl S ” ‘ 
This aed ih i: cay the “less than or equal to” notation for req 
than La. Jete problems are the problems whose status are 


ic. NP comp! 
ie examples of the NP-complete problems are — 


(i) Travelling Salesman Problem — Given n cities, the distance 


between them and a number D, does there exist a tour programme fora 
visit all the cities so that the total distance travelled is atmost D 2 


T harder 
Uction jg 
Unknown, 


salesman to 
(ii) Zero-one Programming Problem — Given m simultaneous 


equations 


m F 
> agxj=bi » i=1,2...0 
Fl 


Does there exist values, zero or one, for xj SO that the above equations are 
satisfied ? 

(iii) Satisfiability Problem — Given a formula involving propositional 
variables and logical connectives. Does there exist a choice of truth values for 
the variables for which the given formula assumes the truth value T, 

A language L < [0, 1)’ is NP-complete if 
1 LeNP,and 
2 L'<pL for every L' € NP. 


0.46. Define NP completeness and reducibility of problems, What are 


NP hard problems ? (R.GP.¥., Dec. 2009) 
Or 

Explain NP-complete and NP-hard problems. (R.GPV, June 2010) 
Or 


What do you understand by NP-hard and NP-complete classes ? 
(R.GPV, Dec. 2012) 
Or 


Explain NP-complete and NP-hard problem. (R.GPV., Dee. 2017) 


Ans. NP-completeness — Refer to Q45. 


If'a language L satisfies property 2, but not necessarily proper'Y a 
say that language L is NP-hard. A problem that is NP-complete has the PP . 
that it can be solved in polynomial time if and only if all other NP-compl? a 
Problems can also be solved in polynomial time. If an NP-hard problems ti 
be solved in polynomial time, then all NP-complete problems can be aol 
Polynomial time, All NP-complete problems are NP-hard, but some N"" 


problems are not known to be NP-complete. 
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Q.47. Show that the travelling salesman Problem is NP-complete. 

(R.GPV, June 2008, 2013) 

Ans. Proof — We first show that TSP (Travellin 
pelongs to NP. Given an instance of the problem, we use as a certificate the 
sequence ofn vertices in the tour. The verification algorithm checks that this 
sequence contains each vertex exactly Once, sums up the edge costs, and 
checks whether the sum is at most k. This process can certainly be ‘done in 
polynomial time. 

To prove that TSP is NP-hard, we show that HAM-CYCLE < p TSP. Let 
G=(V, E) be an instance of HAM-CYCLE. We construct an instance of TSP 
as follows. We form the complete graph G' = (V, E'), where E' = {G, j): i,j € 
Vy}, and we define the cost function c by 


0 
e(i, j) = if 


The instance of TSP is then (G’, c, 0), which is easily formed in polynomial 
lime. 

We now show that graph G has a Hamiltonian cycle if and only if graph 
G'has a tour of cost at most 0. Suppose that graph G has a Hamiltonian cycle 
h. Bach edge in h belongs to E and thus has cost 0 in G'. Thus, h is a tour in 
G' with cost 0. Conversely, suppose that graph G' has a tour h' of cost at most 
0. Since the costs of the edges in E' are 0 and 1, the cost of tour h' is exactly 
0. Therefore, h' contains only edges in E. We conclude that h is a Hamiltonian 
‘ycle in graph G. 

Q.48. Show that the Hamiltonian-path problem is NP-complete. 

(R.GRYV., June 2008) 


ig-salesman problem) 


if(i, j) €E, 
if (i, ) ¢E. 


Or 
Show that Hamiltonian cycle problem is NP-complete. 
(R.GP.V., June 2012) 
Ans. We first show that HAM-CYCLE belongs to NP. Given a graph 
Ss, E), our certificate is the sequence of |V| vertices that make up the 
Hamiltonian cycle, The verification algorithm checks that this sequence contains 
"ch Vertex in V exactly once and that with the first vertex repeated at that 
by if forms a cycle in G. This verification can be performed in polynomial 
‘ime, 
We now prove that HAM-CYCLE is NP-complete by showing that 3 
°NE-SAT < pHAM-CYCLE. Given a 3-CNF boolean formula 6 over variables 
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Xp Xp ee Xe with clauses Cy, Cz, «++» C, each containing exactly 3 
literals, we construct a graph G= (V, E) in polynomial time such that 
Hamiltonian cycle if and only if 6 is satisfiable. Our construction js }, 
widgets, which are pieces of graphs that enforce certain properties, 
Our first widget is the subgraph A shown in fig. 5.46 (a). Suppose tha 

is a subgraph of some graph G and that the only connections between i LA 
the remainder of G are through the vertices a, a’, b and b'. Fy; the and 
suppose that graph G has a Hamiltonian cycle. Since any Hamiltonian 


distingy 
Ghas a 
ased on 


More, 
cycle of 


G must pass through vertices Z,, 2), 23 and z, in one of the ways shown ji 
fig. 5.46 (b) and (c), we may treat subgraph A as if it were simply a pair a 
edges (a, a’) and (b, b’) with the restriction that any Hamiltonian cycle ra 
must include exactly one of these edges. We shall represent widget A as shown 
in fig. 5.46 (d). 


Fig. 5.46 

The subgraph B in fig. 5.47 is our second widget. Suppose that B is ® 
subgraph of some graph G and that the only connections from B to the remainder 
Of G are through vertices by, bp b; and b,. A Hamiltonian cycle of graph 
cannot traverse all of the edges (b;, b,), (b,, bs) and (bs, b. .), since then all 
vertices in the widget other than b, b,, b; and by would be missed. Howevet, 
fe ealisaian cycle of G may traverse any proper subset of these edges: 
cee ® to (e) show five sv +h subsets; the remaining two subsets hak 
is eee a top-to-bottom flip of parts (b) and (e). This Wt 
pointed to by the a fig. 5.47 (f), the idea being that at least one of the P 

ry the arrows must be taken by a Hamiltonian cycle. 
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Fig. 5.47 
The graph G that we shall construct consists mostly of copies of these 
two widgets. The construction is shown in fig. 5.48. For each of the k clauses 
in $, we include a copy of widget B, and we join these widgets together in 
series as follows. Letting b,; be the copy of vertex b; in the i" copy of widget 


i=1,2, k-1. 


B, we connect b; 4 to bi 41,1 for 
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Then for each variable x,, in , we include two vertices x' e, 
These two vertices are connected by means of two copies of a Xe - aa te a, "lat pista: 
x",,), which are denoted by e,, and @- The idea is that if the Tisha, Ory eP i) be sii 
cycle takes edge e,,, it corresponds to assigning variable Xm the value | (em @ iba an 2a) - 
Hamiltonian cycle takes edge €,, the variable is assigned the value 0. whic Gi) between (b225 by 3) and ©, and 
pair of these edges forms a rie these small loops are connected (iii) between (b, 3, b, 4) and & 
series by adding edges (x',, x"), 4 1) form = 1, 2, .....n—1. The] fe that co ing t . : 
side of the graph is Sonested to the right (variable) side by ee =, Be i ri on a a hn 3 i ey ele 
edges (b, 1, /,) and (b,,4, x",) Which are the topmost and bottommost Spee of course, adding the connections that pass eo dhcoe of fig. 5.46 (a) and, 
in fig. 5.48. given literal /,, may appear in several clauses (for haps a rl 
and thus an edge e,, or €, may be influenced by eieal tulle ae 
example, edge @; ). In this case, we connect the A widgets in series, as hie : 
in fig. 5.49, effectively replacing edge €,, OF €, bya series of ido a 


218 (x) Vx, vx;), 


(a) A Portion of Fig. 5.47 (b) The actual Subgraph Constructed 
Fig. 5.49 

We claim that formula ¢ is satisfiable if and only if graph G contains a 
dimiltonian cycle. We first suppose that G has a Hamiltonian cycle hand 

We are not i 5 ‘ow that ¢ is satisfiable. Cycle h must take a particular form — 
yet to relate the oh finished with the construction of graph G, since We have (i) First, it traverses edge (bj, 1, *';) to go from the top left to the 
einen sine * men to the clauses. If the j' literal of clause ¢; iS Xm “a top right. is 

el : 
eet eae (bis by, 5+ 1) With edge ey If the j* ier (ii) Itthen follows all of the x’, and x’, vertices from top to bottom, 


of clause Gis x, then we ii i 
instead put an A widget between edge (bj by j+! shoosing either edge €,, or edge Fm, but not ~ 


Fig. 5.48 
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(iii) It next traverses edge (by, 4, X",) to get back to the leg, és 
+ ie, 
(iv) Finally, it traverses the B widgets from bottom to {0p ott 
le 


left. 

Given the Hamiltonian cycle h, we define a truth assignment for ¢ 
follows. If edge &, belongs to h, then we set x,, = 1. Otherwise, ie pas 
belongs to h, and we set x, = 0. &m 

We claim that this assignment satisfies ¢. Consider a clause C, and th 
corresponding B widget in G. Each edge (bj jb; j 4.1) is connected by ae 
widget to either edge €,, OF edge €,, depending on whether x, or =x, isthe 
j literal in the clause. The edge (b;, p b, j+ }) is traversed by h if and only if 
the corresponding literal is 0. Since each of the three edges (b; ,, bi) (b, 
bj), (bi 35 b, 4) in clause C; is also in a B widget, all three cannot be ravenna 
by the Hamiltonian cycle h. One of the three edges, therefore, must have a 
corresponding literal whose assigned value is 1, and clause C; is satisfied, This 
properly holds for each clause C,, i= 1, 2, ..., k, and thus formula 4 is 
satisfied. 


Conversely, let us suppose that formula is satisfied by some truth 
assignment. By following the rules from above, we can construct a Hamiltonian 
cycle for graph G — traverse edge ¢,, if x,, = 1, traverse edge Gm ifx,, = 0, 
and traverse edge (bj j, bj, j 4 1) if and only if the j'" literal of clause C; is 0 
under the assignment. These rules can indeed be followed, since we assume 
that s is a satisfying assignment for formula 9. 


Finally, we note that graph G can be constructed in polynomial time. B 
contains one B widget for each of the k clauses in $. There is one A widget for 
each instance of each literal in $, and so there are 3 k A widgets. Since the A 
and B widgets are of fixed size, the graph G has O(K) vertices and edges and 
is easily constructed in polynomial time. Thus, we have provided ap joynomisk 
time reduction from 3-CNF-SAT to HAM-CYCLE. 


0.49. What is vertex cover ? Show that it is NP-complete. 
(R.GRV., Dec 2012) 
with set of 


Ans. Vertex Cover— = i yh 
ex Cover — Let G = (V, E) be an (undirected) grap! “PG if for 


vertices V and edges E. A subset A c V is said to be vertex cover 
every edge (v, w) in E, at least one of v or w is in A. 


, The vertex cover problem is — given a graph G and inte 
lave a vertex cover of size k or less ? 


ger k, does e 


2 Unit-V 247 
To represent this problem as a language L,. consisting of strings of the 
form- k in binary, followed by a marker, followed by the list of verti 
where vj is represented by v followed by i in binary, and a list of edges, iia 
(ve vp 8 represented by the codes for v; and v; surrounded by cen 
[,_ consists of all such strings representing k aul (G uch tht G bas a-vertex 
cover of size k or less. 


Proof— LetA subset of k vertices and check that it covers all edges. This 
may be done in time proportional to the square of the length of the problem 
representation. L,, isshown to be NP-complete by reducing 3-CNF satisfiability 
to Lye 

Let F =F, A By A......0A Fy be an expression in 3-CNF, where each F; 
js a clause of the form (a;, V Oj V a3) each a,; being a literal. We construct 
an undirected graph G = (V, E) whose vertices are pairs if integers (i, j), 1 i 
<2, 1 <j <3. The vertex (i, j) represents the jth literal of the ith clause. The 
edges of the graph are 

(i) (6,3), G, &)] provided j # k and 
Gi) [G, 3), (KD) if ag = > Oy - 

Each pair of vertices corresponding to the same clauses are connected 
by an edge in (i). Each pair of vertices corresponding to a literal and its 
complement are connected by an edge in (ii). 

G has been constructed so that it has a vertex cover of size 2q if and 
only if F is satisfiable. Assume F is satisfiable and fix an assignment satisfying 
F. Each clause must have a literal whose value is 1, Select one such literal 
for each clause. Delete the q vertices corresponding to these literal from V. 
The remaining vertices form a vertex cover of size 2q. Clearly for each i, 
only one vertex of the form (i, j) is missing from the cover, and hence each 
edge in (i) is incident upon at least one vertex in the cover. Since edges in Gi) 
are incident upon two vertices corresponding to some literal and its 
complement, and since we would not have deleted both a literal and its 
complement, one or the other of these vertices is in the cover. Thus we 
indeed have a cover of size 2q- / 

Conversely, assume we have a vertex cover of size 2q, for each i the 
cover must contain all but one vertex of the form (i, d for if two such vertices 
were missing, an edge (Gi, (9) | would not be incident upon any vertex in 


the cover. There can be no conflict because two vertices not in the cover 


cannot correspond to 2 literal and its complement, else there would be an edge 
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in group (ii) not incident upon any vertex of the cover. For this assj 
has value 1. Thus F is satisfiable. We can essentially use the variable. 
the formula F as the vertices of G, appending two bits for the i-component 
vertex (i, j). Edges of type (i) are generated directly from the clauses, vi, 
those of type (ii) require two counters to consider all pairs of literals, Thus we 
conclude that L,, is NP-complete. 


‘snment 
'S Names in 
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B.E. (Fourth Semester) EXAMINATION, Dec. 2012 
ANALYSIS AND DESIGN OF ALGORITHM 
(CS/IT-404) 


Note : (i) Attempt one question from each Unit. 
(ii) All questions carry equal marks. 
. J Unit-1 
1, (a) What is the significance of various asymptotic notations ? Explain by 
giving examples. (See Unit-1, Page 11, Q.15) 
(b) Write short note on Strassen’s Matrix multiplication. Compare it with 
conventional Divide and conquer technique of matrix multiplication. 
(See Unit-I, Page 50, Q.61) 
Or 
2, (a) Explain how time complexity of an algorithm can be calculated ? Give 
suitable example. (See Unit-I, Page 7, Q.9) 
(b) What is divide and conquer strategy ? Write and explain the algorithm 
of Divide and conquer. (See Unit-I, Page 31, Q.32) 
Unit-II 
3. (a) What is greedy strategy ? Write prims minimum cost spanning tree 
algorithm. Determine MST for the following graph. 


(Sce Unit-II, Page 95, Prob.11) 


i i i k i =7,m=15.(P), 

(b) Find an optimal solution to the knapsack instance n Bh 1 
P,...P7) = (10, 5, 15, 7, 6, 18, 3) and (Wj, W3,....W7) = (2, 3, 5, & 

1, 4, 1). (See Unit-II, Page 100, Prob.15) 


Or . 
4. (a) Find the optimal merge pattern for following data : 
1,,35,.3;.11 
PEGE SEH ERY (See Unit Page, Prob.2} 
b tain a set of optimal Huffman code for the messages (m,, m»,...™7 
” Ra ara frequencies (diy-s47) = (4, 5, 7, 8, 10, 12, 20). Draw 


the decode tree for this set of codes. (See Unit-Il, Page 88, Prob.5) 
Unit-II 


8 (a) What are the key ingredients a an optimization problem must have 
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i mming to be applicable ? Explain them, 
for dynamic progral iS (See UnitlL, Page rip a 
i lgorithm. What is its runningtime?” 
(b) Give Floyd Warshall Algi (See Unitall, Page 124, Q21) 
Or 
ine an LCS of <1, 0, 0, 1 0, 1, 0, 1> and <0, 1,0, 1, 1,0,1, 10> 
oe) Oe ynaiais programming can be applied to LCS? y 
(See Unit-IH, Page 135, Prob.12) 
(b) Define all-pairs shortest path problem. Discuss solution of this problem 
based on Dynamic programming. (See Unit-1I1, Page 122, Q.20) 
Unit-IV 
7. (a) Explain backtracking. Write an algorithm to estimate the efficiency of 
backtracking. _ Gee -IV, Page 137, Q.1) 
(b) What is graph colouring program 2 Give an algori thm for 3 colouring 
of a graph. a (See Unit-IV, Page 154, Q.20) 
7" 

8. (a) Explain how branch and bound method can be used to solve any 
problem ? What is least cost search 2? (See Unit-IV, Page 159, Q.25) 

(b) Explain the following with suitable examples. 
(i) Hamiltonian cycle (See Unit-IV, Page 148, Q.15) 
(ii) Parallel Algorithms (See Unit-IV, Page 182, Q.33) 

Unit-V 
9. (a) Define B-tree-Insert the entires below, in the order stated, into an 
initially empty B-tree of order 4. 

1, 5, 6, 2, 8, 11, 13, 18, 20, 7, 9 (See Unit-V, Page 218, Prob.11) 
(b) What is binary search tree ? Give a comparison of binary search tree 


and Heap. (See Unit-V, Page 185, Q.2) 
Or 
? 
10.(a) What do you understand by NP-hard and NP-complete classes ? 
Explain. y (See Unit-V, Page 240, Q.46) 


(b) What is vertex cover ? Show that it is NP-complete. 
(See Unit-V, Page 246, Q49) 


B.E. (Fourth Semester) EXAMINATION, June 2013 
ANALYSIS AND DESIGN OF ALGORITHM 
(CS/1T-404) 


Note : Attempt one question from each unit, including sub parts. All questions 
carry equal marks. 
Unit-I siti 
1. (a) Describe the methods of analyzing an algorithm. What do you f an 
by best case, average case and worst case time complexity 0 8) 
algorithm. (See Unit-1, Page 6 
(b) Explain divide and conquer technique. Design a recursive algo! 
(2) 


. (a) Obtain a set of optimal Huffman c 


. (a 
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for binary search, 


ae (See Unit-I, Page 36, Q.42) 


. (a) Explain heap sort algorithm with 


(b) Solve the recurrence relation — cempleles Uaes, Page 23, Q.30) 
T(n) = 3(n/4) +n 


(See Unit-1, 
Unit-11 nit-I, Page 53, Prob.6) 


1 I ‘odes for th 
(M),.....2+++My) with relative frequencies Gruss event 
8, 10, 22, 15). Draw the decode tree for this set of codes, eer 


. ‘ (See Unit-II, Page 89, Prob.6) 

(b) Write and explain single source shortest path algorithm with deans 

6 (See Unit-II, Page 81, Q.24) 
ir 

Consider the Knapsack instance n = 3 


(Pj, Po, Ps) = (1, 


, (W1, W2, W3) = (2, 3, 4) and 
2, 5) and m = 5. Find the ‘optimal solution. ‘ 


(See Unit-II, Page 101, Prob. 
(b) There are 5 jobs whose profits ‘ oe 
(P, »Ps) = (20, 15, 10, 1, 6) and deadlines (2, 2, 1, 3, 3). Find 
the optimal solution that minimizes profit on scheduling these jobs. 
Discuss its algorithm too. (See Unit-II, Page 105, Q.19) 
Unit-III 


- (a) Write Floyd-Warshall algorithm to solve all pair shortest path problem. 


Also.write its complexity. (See Unit-III, Page 124, Q.21) 
(b) Show that greedy strategy will not work for 0-1 Knapsack problem, 
Give a dynamic programming based solution for this problem. 
(See Unit-IIl, Page 115, Q.12) 
Or 


. (a) What is multistage graph problem ? Discuss its solution based on 


dynamic programming approach. Give a suitable algorithm and find 
its computing time ? (See Unit-IMl, Page 118, Q.16) 
(b) Explain dynamic programming concept with example. 
3 mm F (See Unit-LII, Page 110, Q.3) 
Unit-IV 


- (a) Explain backtracking technique for designing an algorithm. 


(See Unit-IV, Page 139, Q.4) 
(b) What is Hamiltonian cycle ? Write an algorithm to find all Hamiltonian 
cycle in graph ? (See Unit-IV, Page 148, Q.16) 

Or 


- (a) What is branch and bound technique ? How travelling sales person 


problem can be solved using this technique ? (See Unit-IV, Page 161, ne) 

b i h coloring problem ? Give algorithm to solve this problem? 

— (See Unit-IV, Page 154, Q.20) 
Unit-V 


. (a) Create a B-tree for the following list of elements — 


{86, 50, 40, 3, 94, 10, 70, 90, 110, 113, 116} ; 
Given minimization factor t = 3, minimum degree = 2 and maximum 


(3) 
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degree = 5 
(b) Show that 


(See Unit-V, Page 219, 

the travelling sales man problem is NP-complete, 12) 
(See Unit-V, P; 

‘ate Be 241, Q.47) 

10,(a) Write DFS and BFS algorithms and also analyses the runnin 

i yee : : (See Unit-v, Page 2. 

(by Create an AVL tree for the following. List of elements by in 


g time o 


36, Q.35) 
Serting in 


empty AVL tree (Write step by step insertion). 


BE. (Fourth Semester) EXAMINATION, Dec, 2013 
ANALYSIS AND DESIGN OF ALGORITHM 
(CS/IT-404) 


Note : Question paper is divided into five units. Attempt one question from 
each unit. All questions carry equal marks. 
Unit-1 
1. (a) Write in brief about the significance of the following notations— 7 
(i) ‘0’ (ii) "(iii ‘8” (iv) ‘0’ (v) ‘ow’ 
; ; (See Unit-1, Page 16, Q.23) 
(b) How time complexity of an algorithm is calculated ? Explain with 
suitable example. i (See Unit-I, Page 7, Q.9)7 
ir 
2. (a) Compare Heap and binary search tree. Construct a heap and a binary 
search tree of the following data — 
44, 22, 71, 11, 66, 55, 33, 88, 99 (See Unit-V, Page 207, Prob.l) 
(b) Explain the divide and conquer technique. Write an algorithm to find 
maximum and minimum element in an array using this technique. 7 
(See Unit-I, Page 32, Q.33) 
AiG Wika UNIT-IL > 
+ (a) What is greedy strategy ? Explain optimal merge pattern in brief and 
find an optimal binary merge tree (pattern) for files whose lengths are 
by ahergl2: 15,84, 53, 91,35, Sand 11. (See Unit-I1, Page 85, Prob3)7 
(b) What is minimum spanning tree ? Using Prim’s algorithm find minimum 
spanning tree of the following graph. a 


(See Unit-U1, Page 94, Prob10) 


Or 
find the optimal solution to the Knapstk 


4. (a) What is Knapsack problem, 


(4) 
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instance n = 3, m = 20, (p,, po, P3) = (25, 24, 15) and (w), Wo, W3) 
= a 8, 15, 10). (See Unit-I, Page 100, Prob.14) 7 
(b) Write an algorithm for job sequencing problem with deadline. Also 
discuss its complexity. (See Unit-II, Page 79, Q.22) 7 
; UNIT-IIT 
. (a) What is dynamic programming ? Compare it with greedy method. 7 
, (See Unit-I1, Page 112, Q.6) 
(b) What is LCS problem ? Write an algorithm to solve longest common _ 
sequence problem using dynamic programming approach. y/ 
(See Unit-ITI, Page 126, Q.22) 


wm 


Or 

6. (a) Explain Floyd Warshall algorithm with the help of an example. a/ 
(See Unit-IT, Page 124, Q.21) 
(b) Whatis reliability design problem ? Explain. (See Unit-III, Page 120, Q.17) 7 

UNIT-IV 
7. (a) Explain Backtracking. How backtracking algorithm can be used to 
solve 8 queens problem ? (See Unit-IV, Page 143, Q.10) 7 
(b) Whatare hamiltonian cycles ? Write an algorithm to find all Hamiltonian 
cycles in a given graph. (See Unit-IV, Page 148, Q.16) 7 


Or 
8. (a) What is branch and bound method, using branch and bound method 
generate a state space tree for the following cost matrix. 7 
ABCD 


Alo 127 4 
B|10 o 13 9 
G=C}]3 8 o 
D[L5 6 10 @ 
(See Unit-IV, Page 168, Q.30) 
(b) Write about parallel algorithms with example. 7 
(See Unit-IV, Page 182, Q.33) 
UNIT-V 
9. (a) Define height balance tree. Construct a height balance tree starting 
with empty tree on the following data — 
Dec, Jan, Apr, Mar, Jul, Aug, Oct, Feb, Nov, May, Jun. 7 
(See Unit-V, Page 215, Prob.8) 
(b) Create a B-tree of order 5 for the following data items — 
D,H, K, J, B, P,Q, EA, 8, WTC, L, N, Y, M. 
(See Unit-V, Page 220, Prob.13) 
Or 


10. in the following with examples. 7x2 
aa a ° (See Unit-V, Page 200, Q.12) 
(b) NP-Completeness. (See Unit-V, Page 239, Q.45) | 

) 
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3. (a) What is the principle of optimality ? Explain with example. 
BEE. (Fourth Semester) EXAMINATION, June 2914 os caliente ‘ ; (See Unit Pegeii,05) 
ANALYSIS AND DESIGN OF ALGORITHM (b) ie ‘istage graph problem with the help of suitable algorithm. 2 
(CS/IT-404) (c) Find optimal solution for 0/1 Giessen Gee we 
(10, 15, 6, 9); (Py, P2, P3, Py) = (2, 5, 8, 1) and M = 40." Bae 3 
(See Unit-III, Page 129, Prob.4) 


Note: (i) Answer five questions. In each question part A : 1) Find a minimu seagate ? 
compulsory and D part has internal choice. * BL Gis - dynamic ne ho SS 
(ii) All parts of each question are to be attempted at one plac ’ 
(iii) All questions carry equal marks, out of which part A and ae 
50 words) carry 2 marks, part C (max. 100 words) carry 3 (Max. 
part D (Max. 400 words) carry 7 marks. mates, 
(iv) Except numericals, Derivation, Design and Drawin, 
. * : tc, 
1. (a) What are different asymptotic notations used ? Eysliin, 7 2 
, (See Unit-I, P: 
(b) Explain the strassen’s multiplication technique. = He 
: (See Unit-I, Page 5 
(c) Explain how to apply the divide and conquer strategy. fener oe 
lements using quick sort ? see 
el ts usi Z quick sort ? (See Unit-l, Page 45, Q.54)3 (See Unit-II, Page 130, Prob.6) 
(@) Following nodes are inserted in empty tree to form minimum heap. Or 
wa neat sketches show how insertion will be done 8, 7, 11, 6, 2,1, Explain Floyd-Warshall algorithm with suitable example. 7 
» 12. (See Unit-I, Page 24, Prob.2)7 (See UnleIIl, Page 124, 021) 
5 : : : Or 4, (a) Explain the concept of backtracking. (See Unit-IV, Page 139, Q.4) 2 
ort the given list using merge sort 70, 80, 40, 50, 60, 12, 35, 95, 10.7 (b) Write a pseudo algorithm fon graeh a nee 153, Q. i 
» 10. t-IV, Page 153, Q. 
. Z (See Unit-I, Page 58, Prob.i1) What i iltoni: Ice ? Explai if be solved usi 
2. ie arg ential merge (pattern) in brief. (See Unit-ll, Page 66, Q.5)2 ©) hadrian aaa seal Se Tai Eaee 148, 0.18): : 
general characteristics of greedy algorithm. 2 (d) Draw the portion of state space tree generated by LC branch and 
(©) Gi . (See Unit-L, Page 66, Q.4) bound for the following Knapsack instance n = 4, (Pj, Po, P3, P4) = 
ive an algorithm for computing minimum spanning tree. 3 (10, 10, 12, 18); (wy, Wa» W3» Wa) = 2, 4,6, 9)andM= 15. 7 
alain, (See Unit-Il, Page 72, Q.12) ee (See Unit-IV, Page 178, Prob.7) 
imum spanning tree usii im’: i i 
below. e using Betis alporiihaggor graph ces Consider the travelling salesman on instance defined by cost matrix — 


o 7 3 1 8 
3 © 6 4 9 
5 8 o 6 18 
9 3 5 @ Il 
1 14 9 8 © 


18 Obtain the reduced cost matrix and solve it. 7 
(See Unit-Il, Page 94, Prob.9) _ Gee Unit-1V, Page 168, Prob.3) 

Explai i Or 5. (a) Explain 2-3 trees with the help of suitable example. 2 
‘plain how job sequencing with deadline can be solved using greedy (See Unit-V, Page 200, Q.12) 


(b) What js AVL tree ? Discuss its properties. (See Unit-V, Page 191, Q.6) 


ai 
poroach. (See Unit-II, Page 79,0207 @ 


6) 
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(c) What is P, NP class problems ? Explain the concept with Suitable 
example. Q.42)3 


(See Unit-V, Page 23g, 
the elements in the order shown to build them into an AV) 
@ Bn detect the complexity of this procedure 1, 26, 2, 25, ae 
Also dete : (See Unit-V, Page 215, Prog) 
yy Tr ; 


Create a B-tree for the following list of elements L = {86, 50, 49 3 
94, 10, 70, 90, 110, 113, 116} given minimization factor = as 


t=3, mini 
degree = 2 and maximum degree = 5. (See Unit-V, Page cua 


219, Prob.12)7 


B.E. (Fourth Semester) EXAMINATION, Dec, 2014 
ANALYSIS AND DESIGN OFALGORITHM 
(CS/IT-404) 


Note: (i) Answer five questions. In each question part A, B, C is 
compulsory and D part has internal choice. , 
(ii) All parts of each question are to be attempted at one place. 
(iii) All questions carry equal marks, out of which part A and B 
(Max. 50 words) carry 2 marks, part C (max. 100 words) carry 
3 marks, part D (Max. 400 words) carry 7 marks. 
(iv) Except numericals, Derivation, Design and Drawing ete. 
1. (a) What do you mean by performance analysis of an algorithm ? Explain. 
; (See Unit-1, Page 5, Q.5) 
(b) What are the different asymptotic notations used ? Explain, 
, (See Unit-, Page 11, Q.15) 
(c) Explain any one application that can be solved by divide and conquer, 
F (See Unit-I, Page 34, Q.3: 
(d) Write down Strassen’s algorithm for multiplication. ~~" 
(See Unit-I, Page 50, Q.61) 


r 
How recursive algorithms are analyzed ? Analyze the execution time 
of recursive algorithm for tower of Hanoi; problem. 
2. (a) What d F P (See Unit-1, Page 9, Q.11) 
(b) What i © you mean by feasible solution 2. (See Unit-HI, Page 65, Q.2) 
(ce) Write tho imum spanning tree ? (See Unit-ll, Page 71, Q.10) 
rite the general characteristics of Greedy algorithm. 
(d) Find th (See Unit-I1, Page 66, Q.4) 
nd the shortest path from vertex 1 to vertex 3 in the following 
Weighted graph using Dijkstra’s greedyalgorithm. 


(See Unit-II, Page 107, Prob23) 


(b) 


(a) 


(a) 
(b) 


(ce) 
(d) 


(a 
(b 
(c) 
@) 


= 
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Or 
Find the optimal binary merge tree (pattern) for ten files whose le: 
are 28, 32, 12, 5, 84, 53, 91, 35, 3 and th Also find its riche 
external path length. (See Unit-II, Page 84, Prob.1) 
What is principle of optimality ? Explain with example. 
‘See Unit-ILl, P: . 
Write the characteristics of dynamic pigoeaee REED 
: (See Unit-II, Page 111, Q.4) 
Give the commonly used designing steps for dynamic programming 
algorithm. (See Unit-II, Page 113, Q.8) 
Consider the Knapsack instance with 5 objects and a capacity m = 
11, profits p = (5, 4, 7, 2, 3) and weights w = (4, 3, 6, 2, 2). Solve 
it using dynamic programming approach. 
6 (See Unit-IIl, Page 128, Prob.3) 
Ir 


What is multistage graph problem ?Discuss its solution based on 
dynamic programming approach. Give a suitable algorithm and find 
its computing time. (See Unit-II1, Page 118, Q.16) 
Explain the use of bounding function. (See Unit-IV, Page 157, Q.23) 
Explain how to solve sum of subset problem ? 
(See Unit-IV, Page 160, Q.26) 
What is Hamiltonian cycle ? Explain how it can be solved using 
backtracking algorithm. (See Unit-IV, Page 148, Q.16) 
Draw the portion of state space tree generated by LC branch and 
bound for the following Knapsack instance n = 4, (P,, P2,P3, Py) 
= (10, 10, 12, 18); (Wy, Wz, W3, Wg) = (2, 4, 6, 9) land M = 15. 
(See Unit-IV, Page 178, Prob.7) 


Or 
Consider the travelling salesman on instance defined by the cost matrix— 
o 7 3 12 8 
3 © 6 14 9 
5 8 © 6 18 
oS 3 5 @ Il 
18 149 8 ow 


Obtain the reduced cost matrix and solve it. 
(See Unit-IV, Page 168, Prob.3) 
Explain binary search tree. List out its properties. 
(See Unit-V, Page 185, Q.1) 
Explain 2-3 trees with the help of suitable example. 
(See Unit-V, Page 200, Q.12) 
What is P, NP class problems ? Explain the concept with suitable 
example. (See Unit-V, Page 238, Q.42) 
Obtain height balanced trees starting with empty tree on the following 
set of instructions — 
Dec, Jan, Apr, Mar, Jul, Aug, Oct, Feb, Nov, May, June. 
(See Unit-V, Page 213, Prob.7) 


(9) 
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Or 
ving list {5, 6, 
Construct an AVL tree for the na = nis me he 
inserting the elements successively, s oN Poy tres, 
i (See Unit-V, Page 210, Prob.s) 


B.E, (Fourth Semester) EXAMINATION, June 2015 
ANALYSIS AND DESIGN OF ALGORITHM 
(CS/IT-404) 


Note: (i) Answer five questions. In each question part A, B, C is 


1. 


(a) Define Q notation. 


(b) What is the use of asymptotic notations ? (See Unit-1, Page 11, Q.14) 
(c) Define binary tree. 


(d) How divide and conquer technique can be applied to binary trees? 


compulsory and D part has internal choice, 
(ii) All parts of each question are to be attempted at one place. 
(iii) All questions carry equal marks, out of which part A and B 

(Max. 50 words) carry 2 marks, part C (max. 100 Words) carry 

3 marks, part D (Max. 400 words) carry 7 marks. 
(iv) Except numericals, Peseatan Design and Drawing ete, 

nit- 
(See Unit-1, Page 14, Q.17) 


(See Unit-V, Page 185, Q.1) 
Also write algorithm for divide and conquer. (See Unit-I, Page 34, Q.36) 
Or 


Define and explain merge sort algorithm. (See Unit-I, Page 44, Q.50) 
Unit-I1 

(a) Explain about greedy technique. 
(b) Define the external path length. (See Unit-Il, Page 69, Q.8) 
(c) Define minimum spanning tree. (See Unit-Il, Page 71, Q.10) 
(d) Define Kruskal’s algorithm. Also write down the steps for Kruskal’s 
algorithm in detail. (Sce Unit-II, Page 74, Q.13) 


(See Unit-Il, Page 65, Q.1) 


Or 7 i 
Define preorder, inorder and postorder traversal. Also explain in detail 
all the traversals, (See Unit-¥, Page 229, Q.25) 


; Unit-11T 

(a) Explain principle of optimality. (See Unit-II1, Page 111,05) 
(b) Define dynamic Programming. (See Unit-II1, Page 109, 1) 
(c) Define binomial coefficient. (See Unit-II1, Page 113, Q9) 
(@) Explain 


Warshall’s algorithm, (See Unit-IHI, Page 124,021) 


Find an optimal solution t fc i ack problem — 
Number of able any the following Knapsack p1 


Knapsack capacity m = 20 

Waltts © Po» Ps) = (25, 24, 15) 
eights (w,, Wo, W3) = (18, 15, 10). prob.l3) 

* (See Unit-II, Page 98; 

(10) 


4 @) 
(b) 
(c) 
() 


5. (a) 
(b) 
(c) 
(@) 
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Unit-IV 
Explain state space tree, (See Unit-IV, Page 140, Q.5 
Explain n-queens problem. (See Unit-IV, Pace 146, A 
Explain graph coloring problem. (See Unit-IV, Page 151, Q.18) 
How can travelling salesperson problem be solved ? 
a (See Unit-IV, Page 162, Q.28) 
ir 

Explain backtracking in detail. Aj 


Iso write algorithm for recursiv 
backtracking algorithm. oar 


(See Unit-IV, Page 139, Q.4) 
Unit-V - om) 


Explain class P problem. 

Explain undecidable problem. 

Explain NP-hard problems. 

List out the techniques for traversals in 
detail with its procedure. 


(See Unit-V, Page 238, Q.40) 
(See Unit-V, Page 237, Q.37) 
(See Unit-V, Page 239, Q.43) 
graph. Also explain each in 
(See Unit-V, Page 236, Q.32) 


Discuss the relationshi 
problems, 


ir 
p between P, NP, NP-complete and NP-hard 
(See Unit-V, Page 239, Q.44) 


Note : 


1. (a) 
(b) 
(©) 
(d) 


2. (a) 
(b) 


B.E. (Fourth Semester) EXAMINATION, Dec. 2015 
ANALYSIS AND DESIGN OF ALGORITHMS 
(CS/IT-404) 


(i) Answer five questions. In each question part A, B, C is 
compulsory and D part has internal choice. 

All parts of each question are to be attempted at one place. 

All questions carry equal marks, out of which part A and B (Max. 

50 words) carry 2 marks, part C (max. 100 words) carry 3 marks, 

part D (Max. 400 words) carry 7 marks, 

(iv) Except numericals, Derivation, Design and Drawing ete. 


Show that solution of T(n) = {2h} is O(log n). 

What are the factors which affect the running time of an algorithm ? 
(See Unit-I, Page 8, Q.10) 
Illustrate Heap sort on the array; 
A= [5, 8, 3, 9, 2, 10, 1, 40] (See Unit-l, Page 28, Prob.4) 
Sort the following list using quick sort technique and argue upon its 
running time 

A=[5, 7, 9, 4, 10, 2, 8, 1] (See Unit-I, Page 59, Prob.12) 
ir 

Show how the following matrices would be multiplied using Strassen’s 
algorithm. ‘ 

Explain the concept behind Greedy strategy. (See Unit-II, Page 65, Q.1) 
Write the basic difference between Prim’s algorithm and Kruskal’s 


algorithm. (1) (See Unit-Il, Page 76, Q.15) 


Analysis & Design of Algorithm (B.E., lV-Sem.) 


ider n = 7, m = 15, (Pj, Po, .--.- Pz) = (10, 5, 15, 7, 6 

(c) aa ee W7) = (2,3, 5,7, 1,4, De Obtain the optimal ane a 

this Knapsack instance. (See Unit-I1, Page 100, p, ma for 

(d) Find on optimal merge pattern for 11 files whose length are 2 15) 

12, 5, 84, 5, 3, 9, 35, 3, 11. Write and explain the algoritm mae 2, 

ine i xity. ee Unit-11, Py anc 

determine its complexity. Gr ¢ nit-II, Page 87, Prob 

Write Dijkstra’s algorithm to find the shortest path betw, 

vertices. Using this algorithm find shortest path from vey 
3 in the following weighted graph. 


een two, given 
TeX | to vertex 


(See Unit-Il, Page 10: 

3. (a) What is principle of optimality ? Explain with suablecamine 

; : (See Unit-IIl, Page 111, Q.5) 

(b) Write shortnote on dynamic programming. (See Unit-III, Page 109, Q.1) 

(c) Explain how a reliability design can be obtained using dynamic 

programming. (See Unit-III, Page 120, Q.17) 

(d) Find minimum cost path from ‘S’ to ‘t’ in multistage graph using 
dynamic programming ? 


(See Unit-I11, Page 131, Prob-7) 


Or . 
De ‘ 
eee Knapsack problem is solved using dynamic programminé 
Consider 6 
Find gpatls Was Wa) = (2, 3, 3) and (py, Po, Ba) = (Is 2. 4a 


Find opti ; . 4 
4. (@) Write Hispen solution for given data. (See Unit-II, Page 1 


do algorithm for graph coloring problem. 
(See Unit-IV, Page 155 


77, Prob-2) 


Q.19) 
(12) 


Analysis & Design of Algorithm (B.E., 1V-Sem.) 
(b) Explain the term lower bound with suitable example. 


, ; (See Unit-IV, Page 180, Q.31) 
(c) What is Hamiltonian cycle ? Explain how it can be solved using 

backtracking algorithm. (See Unit-IV, Page 148, Q.16) 
(a) Consider the following travelling salesman on instance defined by cost 


matrix. 
o 7 3 128 
3 02 6 14 9 
5 8 » 6 18 
Ss “So 
18 14 9 8 @ 
obtain reduced cost matrix and solve it.(See Unit-IV, Page 168, Prob.3) 
Or 


Solve 8-queen’s problem for a feasible sequence (6, 4, 7, 1). 
(See Unit-IV, Page 147, Q.12) 


5. (a) Explain the function for deletion of a node from binary search tree, 


(See Unit-V, Page 189, Q.5) 

(b) Explain 2-3 trees with the help of suitable example. 
(See Unit-V, Page 200, Q.12) 
(c) What is BFS and DFS ? Explain with suitable example with respect to 
tree. (See Unit-V, Page 233, Q.31) 
(d) Insert the elements in the order shown below to build into an AVL tree. 
Also determine the complexity of this procedure 1, 26, 2, 25, 3, 24, 4, 
23, 5, 22, 6. (See Unit-V, Page 215, Prob.9) 

Or 
Discuss the relationship between class P, NP, NP complete and NP 
hard problems with example of each class. 

(See Unit-V, Page 239, Q.44) 


B.E. (Fourth Semester) EXAMINATION, June 2016 
ANALYSIS AND DESIGN OF ALGORITHMS 
(CS/1T-404) 


Note : (i) Answer five questions. In each question part A, B, C is 

compulsory and D part has internal choice. 

(ii) All parts of each question are to be attempted at one place. 

(iii) All questions carry equal marks, out of which part A and B (Max. 
50 words) carry 2 marks, part C (max. 100 words) carry 3 marks, 
part D (Max. 400 words) carry 7 marks. 

(iv) Except numericals, Derivation, Design and Drawing etc. 

(13) 


Analysis & Design of Algorithm (B.E., 1V-Sem.) 


1. (a) Discuss in which condition binary search is better than linear 


; (See Unit-l, Page 37, 
(b) Give the definition of Big “oh” with example. > 


(See Unit-1, Pa, 
(c) Define algorithm. Discuss how to analyse algorithms. eet Q16) 


(See Unit-1, Pages, 
(a) Write the procedure of merge sort and sort the given ai 


tray of | 
step-by-step using merge sort 35, 18, 7, 12, 5, 23, 163 oe 


.Q.7) 
Ments 
(See Unit-1, Page 
Or 8¢57, Prob.g) 
Discuss Strassen’s algorithm for matrix multiplication with exampl 
ic, 


(See Unit-1, Page 50, 
2. (a) What is greedy approach ? (See Unit-It, Page on 4 
(b) How ee way merge pattern can be represented by binary merge 
(See Unit-H1, Pa; 
(c) Discuss job sequencing problem by an example. mL) 
(See Unit-HL, Pa; 79,Q. 
(@) Find an optimal solution to the knapsack instance n 3 eae 
(Pr Pa Ps) = (25, 24, 15) and (Ww), w3, 5) = = (18, 15, 10). 
és (Sce Unit-Il, Page 98, Prob.13) 
Ir 


Given E is the set of edges in graph G. G has n vertices, Cost [u, v] is 

the cost of edge (u, v). T is the set of edges in the minimum-cost 
spanning tree. Write the pseudocode for Kruskal Algorithm by 
considering parameters mentioned above. (See Unit-I1, Page 74, Q.13) 

3. (a) Write short note on dynamic programming. 

nA (See Unit-IIl, Page 109, Q.1) 

(b) How reliability of a system is calculated ? (See Unit-IIT, Page 120, Q.17) 
(c) Discuss 0/1 Knapsack problem. (See Unit-III, Page 114, Q.11) 


(a) Explain multistage graphs. (See Unit-TI, Page 117, Q.15) 
Discuss its applications, 


¥ Or 
Discuss Floyd-Warshall algorithm, Write its pseudocode. 
P (See Unit-IIl, Page 124, Q.21) 
» (a) Define branch and bound method. (See Unit-IV, Page 157, Q23) 
(b) Give the definition of Hamiltonian cycle,(See Unit-IV, Page 147, Q.13) 
(c) Discuss graph colouring for complete graphs. ‘ 
(d) What do you understand by travelling salesman problem ? Discuss 
with suitable example, (See Unit-IV, Page 163,29) 
5 . Or i 
Explain eight queen’s problem and apply backtracking to solve this 
. problem. (See Unit-IV, Page 143,010) 
» (@) Write the rules to construct binary search tree. 1) 
® ¢ (See Unit-V,Page 185.0) 
Ompare DFS and BFS, (Gee Unit-V, Page 231; 


(14) 


Analysis & Design of Algorithm (B.E,, IV-Sem.) 
(c) Discuss polynomial time and non-polynomial time algorithms, 
. : (See Unit-V, Page 23 

(d) Define pent palenced tree. Explain all the rotations perform moe 
the tree with example. (See Unit-v, p: 9 

Or 5 Page 196, Q.9) 

The post order traversal of a bina: 

inorder traversal of T is DBFEAG 

and also writes the steps to con: 

inorder combination. 


ry tree T is DFEBGLIKHCA and 
CLJHK. Construct the binary tree T 
struct the binary tree in postorder- 

(See Unit-V, Page 208, Prob.2) 


B.E. (Fourth Semester) EXAMINATION, Dec. 2016 
ANALYSIS AND DESIGN OFALGORITHMS 
(CS/IT-404) 


Note: (i) Answer five questions. In‘each question part A, B, C is 
compulsory and D part has internal choice. 

(ii) All parts of each question are to be attempted at one place. 

(iif) All questions carry equal marks, out of which part A and B 
(Max. 50 words) carry 2 marks, part C (Max. 100 words) carry 
3 marks, part D (Max. 400 words) carry 7 marks. 

(iv) Except numericals, Derivation, Design and Drawing etc. 

Unit-I 
What is the data structures used to perform recursion ? 


(See Unit-I, Page 33, Q.34) 
(b) What is the purpose of Strassen’s matrix multiplication ? 


(See Unit-I, Page 50, Q.60) 
(c) Why do we use asymptotic notations in the study of algorithms ? 
Briefly describe the commonly used asymptotic notation. 
(See Unit-I, Page 14, Q.19) 
(d) Apply quick sort algorithm for the following array and sort the element 
(Take first element of the list as the pivot element). 
25, 56, 47, 35, 10, 90, 82, 31. 


Also discuss complexity of algorithm. (See Unit-1, Page 62, Prob.15) 
Or . 


Sort the following list using heap sort — 
66, 33, 40, 20, 50, 88, 60, re ee 45, 65. 
i the lexity of the heap sort. 
cana casas Sa (See Unit-1, Page 25, Prob.3) 
Unit th so fieoieraaied 
2. t i edy techniques ? Derive the equation for the optimal 
sw ib ecthas (See ve Fas e608) 
differences between Kruskal’s and Prim’s algorithm. 
ee (See Unit-II, Page 76, Q.15, 
(c) Solve the following instances of the single source shortest pat! 
problem with vertex ‘a’ as the source. 


(15) 
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3. 


(See Unit-I, Page 19 
(a) Construct a Huffman code for the following data a 6, Prob.2) 


Character | A B € D E 


Probability | 0.4 | 0.1 | 0.2 | 0.15 | O45 


Decode the text whose ending 100010111001010 


huffman code, Using the above 


a (See Unit-I, Page 91, Prob.7) 
Write a greedy algorithm for sequencing unit time jobs with deadlines 
and profits. Using this algorithm, 


find the optimal solution when 
n=5. 


(See Unit-I1, Page 105, Prob.20) 


Unit-IIl 


(a) Explain the concept of dynamic programming. 
(See Units, Page 109, Qi) 

A Programming solution for computing bino! 
(c SpeBclents. . (See Unit-I if Page 114, Q.10) 

) at is the concept of reliability design in dynamic pre Oo. i?) 

. ‘See Unit-III, Page 120 “2: 
(@) bites Floyd Warshall algorithm solve the all pair shortest path proble 
¢ graph. Where weight matrix is given below — 


(b) Give a dynamic 


0 3 


agsNn 
Bx 8 
o 8 
o~ 8 8 


1) 
(See Unit-111, Page 134.0" 


(a) 
(b) 


(ce) 
(d) 


(d) 
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Or 
Solve the following instance of 0/1 Knapsack problem using dynamic 
algorithm. 


| Item 1 2 
Weight 4 7% 5 3 
$42 T $25 | $12 


a4 


Value | $40 


The capacity of Knapsack W is 10. (See Unit-IIl, Page 126, Prob.1) 
Unit-IV 

Define hamiltonian cycle with example. (See Unit-IV, 

Explain graph coloring problem with their complexit 

(See Unit-IV, Page 155, Q.21) 

‘What is backtracking ? Find a solution to the 4-Queen problem using 


backtracking strategy. (See Unit-IV, Page 142, Q.8) 
Solve the following instance of the Knapsack problem by the branch 
and bound algorithm. 


Page 148, Q.15) 


Item | Weight | Value Value 
‘eight 
1 4 40 10 
2 7 42 6 
3 5 25 5 
4 3 12 4 
The Knapsack capacity W is 10. (See Unit-IV, Page 177, Prob.6) 
Or 
List out parallel algorithm and compare them with different factors. 
Unit-V 


How multiway search is different from binary search tree 2 
(See Unit-V, Page 203, Q.18) 
Explain the concept of height balanced trees with their operations. 
i (See Unit-V, Page 200, Q.11) 
Construct a B-tree of order 3 for the following set of input data — 
43, 16, 25, 40, 132, 100, 145, 7, 15, 18. 
on ‘ (See Unit-V, Page 222, Prob.14) 
ite any two data structures that are suitable for representing a 

be Write an algorithm for depth first traversal of a graph using 
‘one of your two data structures. (See Unit-V, Page 232, Q.30) 

Or 

(17) 


Analysis & Design of Algorithm (B.E., IV-Sem.) 


Write a short notes on the following (any three) 
(i) 2-3 tree (See Unit-y, 


-V, Page 209, 
(ii) NP completeness problem (Sce Unit-V, Page 239; 012) 
(iii) Lower bound theory (See Unit-1v, Page 180, 03) 
(iv) Merge sort. (See Unit-1, Page37, Q.45) 


B.E. (Fourth Semester) EXAMINATION, June 2017 
ANALYSIS AND DESIGN OF ALGORITHMS 
(CS/1T-404) 


Note: (i) Attempt any five questions. 
(ii) All questions carry equal marks. 
1, (a) What are the differences between Big-Oh (O), Omega (@) and Theta 
(8) notations ? . (See Unit-1, Page 14, Q.18) 
(b) Is there any difference among algorithm, pseudocode and program ? 
Explain. “ ' (See Unit-I, Page 3, Q.2) 
2. (a) Apply binary search to find 123 in a list — 
45, 96, 105, 121, 145, 192, 199, 205, 245, 275, 123, 850, 905. 
(See Unit-1, Page 54, Prob, 
(b) Sort the following list using quick sort — ii = obi) 


36, 95, 42, 12, 08, 66, 72, 5 (See Unit-1, Page 59, Prob. 
3. (a) How divide and conquer technique can be applied to binary ween 
Also write algorithm for divide and conquer. (See Unit-1, Page 34, Q.36) 
(b) Explain strassen’s matrix multiplication with the help of an example. 
. . . (See Unit-1, Page 51, Q.61) 
4. (a) What is spanning tree ? Write Kruskals algorithm with an example to 
find minimal spanning tree. (See Unit-H1, Page 76, Q.14) 
(b) A Knapsack capacity is 100. The weights and values of five objects 
are as follows — 


Weight W;: 10 20 30 40 50 
ValueP;: 20 30 66 20 60 


Solve the Knapsack problem using Greedy strategy and find the 


maximum profit that can be obtained. (See Unit-Il, Page 102, Prob.17) 
5. (a) Use the Floyd-warshall algorithm sad ind all pair shortest paths for 


the following adjacency weighted matrix. 


0 4» 3 
o 021 
5 3 0 © 
lo 2 0 


(See Unit-III, Page 133, Prob-10) 


Solve the following multistage problem using both forward and 
backward reasoning. z 


(b) 


(18) 
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. ' (See Unit-IIl, Page 131, Prob.8) 
6. (a) Colour the following graph using a vertex colouring algorithm. What 
is the minimum number of colours required ? 


‘onl 
@) @) 

(See Unit-IV, Page 156, Prob.1) 
(b) Solve the TSP using branch and bound technique — 


3 
3 
c) 


(See Unit-IV, Page 176, Prob.4) 
7. (a) Show preorder, inorder and postorder for the following tree — 


(A) 
(3) © 
ORG 
© © (See Unit-V, Page 230, Q.27) 


t is a B-tree ? Write down the properties of a B-tree. Illustrate 
es bedi aregres with an example. (See Unit-V, Page 202, Q.16) 

8. Write short notes — 
(a) Parallel algorithm 
(b) NP completeness 
(c) Reliability design. 


w 
8 


is) 
> 


(See Unit-IV, Page 182, Q.33) 
(See Unit-V, Page 239, Q.45) 
(See Unit-IIl, Page 120, Q.17), 
CS-228 (CBCS) Pi 
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Note: (i) Attempt any five questions. 
(19) 


Analysis & Design of Algorithm (B.E., |V-Sem.) 


(ii) Each question carries equal marks. 
1. (a) What criteria are used during the analysis of the algorithm, 
____ (See Unit-l, Pages, 9g 
(b) What is the significance of asymptotic notation ? .6) 
_ 1... (See Unit-1, Page 11,.Q13) 
2. (a) Explain Strassen’s matrix multiplication algorithm ? 13) 


(See Unit-1, Page 51,61) 
(b) Solve the following recurrence relation — 


Tin)=31(%4)+n (See Unit, Page 3, Prob 6 


3. (a) Explain how to apply the divide and conquer strategy for Sorting the 
elements using quick sort ? (See Unit-1, Page 45, Q.54) 
(b) Write and explain an algorithm to search an item in array using divide 

and conquer strategy with complexity O(log,n). 


(See Unit-l, Pa: 36, Q. 
4. (a) Explain the greedy strategy. Write algorithm for Knapsack one 


: : (See Unit-II, Page 78, Q.18) 
(b) Find the optimal merge pattern for the following data — 
28, 32, 12, 5, 84, 53, 91, 35,3, 11. (See Unit-II, Page 85, Prob.2) 
5. (a) Explain reliability design problem with suitable example. 
A ¥ (See Unit-II, Page 120, Q.17) 
(b) Explain dynamic programming with example. 


i . (See Unit-I1], Page 110, Q.3 
6. (a) Design a backtracking for graph-coloring problem. . alk 


: (See Unit-IV, Page 153, Q.19) 
(b) Explain and solve 4-queen’s problem using backtracking. ag 
Z (See Unit-IV, Page 141, Q.7) 
7. (a) A binary tree T has 9 nodes the inorder and preorder traversal of T 
yield the following sequency of nodes — 
Inorder : E KFHDBG 
Preorder : FAEKCDHGB 
Draw the tree T. 
(See Unit-V, Page 209, Prob.3) 
(b) ‘oblem. 


(See Unit-V, Page 240, Prob.46) 


Explain NP-complete and NP-hard pr 


8. Write short notes (any three) — 
(a) Graph een ) 

(b) Binary search tree 

(c) Parallel algorithm 

(d) Branch and bound 

(e) Minimum spanning tree, 


(See Unit-V, Page 231, Q.28) 
(See Unit-V, Page 185, Q.1) 
(See Unit-TV, Page 182, Q.33) 
(See Unit-IV, Page 157, Q.23) 
(See Unit-Il, Page 71, Q.10) 
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Note: (i) Attempt any five questions, 


(20) 


Analysis & Design of Algorithm (B.E., \V-Sem.) 
(ii) All questions carry equal marks. 
(a) Explain the various criteria used for analyzing algorithm. 
(See Unit-I, Page 5, Q.6) 
(b) Write the merge sort algorithm and discuss its efficiency. Sort list 
E, X, A, M, P, L, E in alphabetical order using merge sort. 
(See Unit-I, Page 40, Q.47) 
What is knapsack problem in greedy strategy ? Write the running time and 
recurrence relation of knapsack algorithm? (See Unit-Il, Page 77, Q.17) 
Explain how to implement Warshall’s algorithm without using extra 
memory for storing elements of the algorithms intermediate matrices, 
(See Unit-III, Page 124, Q.21) 
Apply and explain the backtracking method to solve the following — 
(a) Hamiltonian circuit problem 
(b) Subset-sort problem. 
(See Unit-IV, Page 150, Q.17) 
(a) Implement an algorithm for binary search. Discuss in detail about 
time complexity of binary search algorithm. (See Unit-I, Page 36, Q.39) 
(b) Apply Prim’s algorithm to the following graph. Write their complexity. 
Find the minimum cost. 


(See Unit-II, Page 92, Prob.8) 
(a) Discuss in detail NP complete problems with example. 
(See Unit-V, Page 239, Q.45) 
(b) What is height balanced trees ? Why to be balanced a height in a 
trees ? (See Unit-V, Page 191, Q.6) 
(a) Apply the branch and bound algorithms to solve the travelling 
salesman problem. Use suitable graph. (See Unit-IV, Page 162, Q.28) 
(b) Compare BFS and DFS. (See Unit-V, Page 231, Q.29) 
Write a short notes (any four) — 
(a) B Trees 
(b) Parallel algorithm 
(c) Multistage graphs 
(@) Quick sort 
(e) Graph coloring. 


(See Unit-V, Page 201, Q.13) 
(See Unit-IV, Page 182, Q.33) 
(See Unit-IIl, Page 117, Q.15) 
(Sce Unit-I, Page 44, Q53) 
(See Unit-IV, Page 151, Q.18 
(21) 
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Note: (i) Attempt any five questions. 
(ii) All questions carry equal marks. 
1. (a) Briefly describe the asymptotic notations 


algorithms. Also write the relational Properties of the 
notations. 


Asymptotic 
(See Unit-1, Page 14, Q.20) 
(b) Illustrate the operation of heapsort on the array — 
A=[5,,13,.2,.25,' 7 17,20, 8; 4) 


, E. (See Unit-1, Page 30, Prob.5) 
2. (a) Write the algorithm for binary search. Apply binary search to find 


122 ina list — 
44, 95, 104, 120, 144, 191, 198, 204, 244, 274, 122, 849, 904. 
(See Unit-1, Page $5, Prob.8) 
(b) Discuss the procedure for mergesort. Illustrate how the worst case 
performance of merge sort is better than the quicksort. Sort the 
given array of 8 elements step-by-step merge sort — 
A = [36, 19, 8, 13, 6, 24, 17, 4). (See Unit-1, Page 58, Prob.10) 
3. (a) Explain the concept behind greedy strategy. Using optimal merge 
pattern greedy method, merge the follow 


ing files, f), f, fy, fy and 
fs with 20, 30, 10, 5 and 30 number of elements respectively. 


(See Unit-II, Page 67, Q.6) 
60. The weights and profits of four 


used in the Study of 


(b) A Knapsack capacity is W = 
items are as follows — 


Profit 


Solve the Knapsack problem using Greedy Strategy and find the maximum 
profit that can be obtained, (See Unit-I1, Page 103, Prob.18) 
4. (a) There are 5 jobs whose 


rofits (P}, Po, P3, P4, Ps) = (60, 100, 20, 

40, 20) and deadlines O,, D,, Bt De D) Le 1,3, 2,1), Find 

the optimal solution that maximizes profit on scheduling these jobs. 

i (See Unit-Il, Page 106, Pro! 21) 

() Briefly explain the concept of dynamic programming. Discuss how 
reliability design can be obtained using dynamic programming. 


8. 
(See Unit-III, Page 122, Q.18) 
Find the optimal solution for 0/1 Knapsack problem (Wj, W2, Ws, 
Wa) = (10, 15, 6, 9), (P), Pa, Ps, P,) = (2, 5, 8, 1) and W = 30. 
(See Unit-IIl, Page 129, Prob) 
Problem and apply backtracking to solve » 
(22) (See Unit-IV, Page 143, Q-1 


5. (a) 


(b) Explain 8 queen’s 
Problem. 


Analysis & Design of Algorithm 


6. (a) Colour the following graph using a vertex Colouring algori 
is the minimum colours required.” sere ere lat 


(B.E,, IV-Sem,) 


: (See Unit-IV, Page 157, Prob.2 
(b) Consider the following initial cost i ae 


matrix for Traveling Salesman 
Problem. Solve this problem using branch and bound technique — 


o 45 
Ta § 
4°6 @ 


(See Unit-IV, Page 176, Prob.5) 
7. (a) (i) Insert the following sequence of elements into an AVL tree, 
starting with an empty tree - 10, 20, 15, 25, 30, 16, 18, 19. 
(ii) Delete 30 in the AVL tree that you got and re-balance the tree (if 
required), (See Unit-V, Page 212, Prob.6) 
(b) Illustrate the inorder, preorder and postorder traversals for the 
following binary search tree. 


(See Unit-V, Page 229, Q.26) 
8. Write short notes on any two — 


(a) Strassen’s matrix multiplication 
(b) Parallel algorithms 

(c) B-tree 

(d) NP-Completeness. 


(See Unit-l, Page 51, Q.61) 
(See Unit-1V, Page 182, Q.33) 
(See Unit-V, Page 201, Q.13) 
(See Unit-V, Page 239, Q.45) 
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Note: (i) Attempt any five questions. 
ii) All questions carry equal marks. : , , 
(iii) In case of any doubt or dispute the English version questioi 
should be treated as final. 


(23) 
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(a) What is an asymptotic notations ? Give the different i 
used to represent the complexity of algorithms. nt notations ty 
_ __ (See Unit-1, P. 
(b) Give the divide and conquer solution for binary senreheog sl G15) 
its complexity. See Unit-I, Page 36, Q 4 
(a) Apply quicksort to sort the following list — » 2.41) 
36, 12, 85, 79, 46, 18, 92, 30, 28, 65, 72. (See Unit-I, Page 60, Prob.14 
(b) How can we prove that Strassen’s matrix multiplication 1) 
advantageous over ordinary matrix multiplication ? aS, 
(See Unit-I, P 
(a) What is Knapsack problem ? How can we solve = onal) 


approach ? — ; (See Unit-II, P. 
(b) Write algorithms for single source shortest path and fini 
complexity ? (See Unit-II, Page 82, Q.24) 


(a) Apply Kruskal’s and Prim’s algorithm for the following graph ? Write 
their time complexities. Find the minimum cost in each case. 


. . (See Unit-I, Page 97, Prob.12) 
(b) What is multistage graph ? (See Unit-II, Page 117, Q.15) 
Write down its properties. 
(a) Write down the pseudocode for Floyd Warshall algorithm. Take one 
graph and apply this algorithm to find all pair shortest path on it. 
(See Unit-III, Page 124, Q.21) 
(b) Write the recursive equation for 0/1 Knapsack problem based on the 
principles of optimality. Explain its execution strategy. 
(See Unit-III, Page 117, Q.14) 
(a) Write a detailed note on Parallel Algorithms. 
(See Unit-IV, Page 182, Q.33) 
(b) What is backtracking ? Explain 8 queen’s problem and how can we 


solve it using backtracking ? (See Unit-IV, Page 143, Q.10) 
(a) What is the meaning of lower bound theory and how can it be used 
in solving algebraic problems ? (See Unit-IV, Page 180, Q.32) 
(b) What are B-trees ? Write down its properties ? What is the need for 
B tree ? What is the height of a B tree of order m ? 
, (See Unit-V, Page 202, Qin) 
Write short notes — 
(i) NP-completeness (See Unit-V, Page 239, a4) 
(ii) Tree Traversals (See Unit-V, Page 224, Q.21) 
(iii) Hamiltonian cycle (See Unit-IV, Page 148, 0) 
(iv) Graph coloring problem. (See Unit-IV, Page 151, Q- 
et 
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